Aug 26 11:32:35 user nova-compute[73068]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 26 11:32:38 user nova-compute[73068]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73068) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73068) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73068) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 11:32:38 user nova-compute[73068]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:32:38 user nova-compute[73068]: INFO nova.virt.driver [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 26 11:32:38 user nova-compute[73068]: INFO nova.compute.provider_config [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] Acquiring lock "singleton_lock" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] Acquired lock "singleton_lock" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] Releasing lock "singleton_lock" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] Full set of CONF: {{(pid=73068) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ******************************************************************************** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] Configuration options gathered from: {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ================================================================================ {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] allow_resize_to_same_host      = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] arq_binding_timeout            = 300 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] backdoor_port                  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] backdoor_socket                = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] block_device_allocate_retries  = 300 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] block_device_allocate_retries_interval = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cert                           = self.pem {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute_monitors               = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] config_dir                     = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] config_drive_format            = iso9660 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] config_source                  = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] console_host                   = user {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] control_exchange               = nova {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cpu_allocation_ratio           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] daemon                         = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] debug                          = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] default_access_ip_network_name = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] default_availability_zone      = nova {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] default_ephemeral_format       = ext4 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] default_green_pool_size        = 1000 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] default_schedule_zone          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] disk_allocation_ratio          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] enable_new_services            = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] enabled_ssl_apis               = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] flat_injected                  = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] force_config_drive             = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] force_raw_images               = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] graceful_shutdown_timeout      = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] heal_instance_info_cache_interval = 60 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] host                           = user {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] instance_build_timeout         = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] instance_delete_interval       = 300 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] instance_name_template         = instance-%08x {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] instance_usage_audit           = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] instance_usage_audit_period    = month {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] internal_service_availability_zone = internal {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] key                            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] live_migration_retry_count     = 30 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] log_config_append              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] log_dir                        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] log_file                       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] log_options                    = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] log_rotate_interval            = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] log_rotate_interval_type       = days {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] log_rotation_type              = none {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] long_rpc_timeout               = 1800 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] max_concurrent_builds          = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] max_concurrent_live_migrations = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] max_concurrent_snapshots       = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] max_local_block_devices        = 3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] max_logfile_count              = 30 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] max_logfile_size_mb            = 200 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] maximum_instance_delete_attempts = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] metadata_listen                = 0.0.0.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] metadata_listen_port           = 8775 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] metadata_workers               = 3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] migrate_max_retries            = -1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] mkisofs_cmd                    = genisoimage {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] my_ip                          = 10.0.0.210 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] network_allocate_retries       = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] osapi_compute_listen_port      = 8774 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] osapi_compute_unique_server_name_scope =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] osapi_compute_workers          = 3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] password_length                = 12 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] periodic_enable                = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] periodic_fuzzy_delay           = 60 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] pointer_model                  = ps2mouse {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] preallocate_images             = none {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] publish_errors                 = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] pybasedir                      = /opt/stack/nova {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ram_allocation_ratio           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] rate_limit_burst               = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] rate_limit_except_level        = CRITICAL {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] rate_limit_interval            = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] reboot_timeout                 = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] reclaim_instance_interval      = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] record                         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] reimage_timeout_per_gb         = 60 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] report_interval                = 120 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] rescue_timeout                 = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] reserved_host_cpus             = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] reserved_host_disk_mb          = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] reserved_host_memory_mb        = 512 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] reserved_huge_pages            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] resize_confirm_window          = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] resize_fs_using_block_device   = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] resume_guests_state_on_host_boot = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] rpc_response_timeout           = 60 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] run_external_periodic_tasks    = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] running_deleted_instance_action = reap {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] running_deleted_instance_timeout = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler_instance_sync_interval = 120 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] service_down_time              = 720 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] servicegroup_driver            = db {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] shelved_offload_time           = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] shelved_poll_interval          = 3600 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] shutdown_timeout               = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] source_is_ipv6                 = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ssl_only                       = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] state_path                     = /opt/stack/data/nova {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] sync_power_state_interval      = 600 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] sync_power_state_pool_size     = 1000 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] syslog_log_facility            = LOG_USER {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] tempdir                        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] timeout_nbd                    = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] transport_url                  = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] update_resources_interval      = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] use_cow_images                 = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] use_eventlog                   = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] use_journal                    = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] use_json                       = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] use_rootwrap_daemon            = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] use_stderr                     = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] use_syslog                     = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vcpu_pin_set                   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plugging_is_fatal          = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plugging_timeout           = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] virt_mkfs                      = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] volume_usage_poll_interval     = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] watch_log_file                 = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] web                            = /usr/share/spice-html5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_concurrency.disable_process_locking = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.auth_strategy              = keystone {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.compute_link_prefix        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.dhcp_domain                = novalocal {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.enable_instance_password   = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.glance_link_prefix         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.instance_list_per_project_cells = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.list_records_by_skipping_down_cells = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.local_metadata_per_cell    = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.max_limit                  = 1000 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.metadata_cache_expiration  = 15 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.neutron_default_tenant_id  = default {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.use_forwarded_for          = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.use_neutron_default_nets   = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.vendordata_dynamic_targets = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.vendordata_jsonfile_path   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.backend_argument         = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.config_prefix            = cache.oslo {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.dead_timeout             = 60.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.debug_cache_backend      = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.enable_retry_client      = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.enable_socket_keepalive  = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.enabled                  = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.expiration_time          = 600 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.hashclient_retry_attempts = 2 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.memcache_dead_retry      = 300 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.memcache_password        =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.memcache_sasl_enabled    = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.memcache_username        =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.proxies                  = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.retry_attempts           = 2 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.retry_delay              = 0.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.socket_keepalive_count   = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.socket_keepalive_idle    = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.socket_keepalive_interval = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.tls_allowed_ciphers      = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.tls_cafile               = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.tls_certfile             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.tls_enabled              = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cache.tls_keyfile              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.auth_section            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.auth_type               = password {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.cafile                  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.certfile                = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.collect_timing          = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.cross_az_attach         = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.debug                   = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.endpoint_template       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.http_retries            = 3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.insecure                = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.keyfile                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.os_region_name          = RegionOne {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.split_loggers           = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cinder.timeout                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.cpu_dedicated_set      = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.cpu_shared_set         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.image_type_exclude_list = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.resource_provider_association_refresh = 300 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.shutdown_retry_interval = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] conductor.workers              = 3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] console.allowed_origins        = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] console.ssl_ciphers            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] console.ssl_minimum_version    = default {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] consoleauth.token_ttl          = 600 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.cafile                  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.certfile                = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.collect_timing          = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.connect_retries         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.connect_retry_delay     = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.endpoint_override       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.insecure                = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.keyfile                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.max_version             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.min_version             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.region_name             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.service_name            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.service_type            = accelerator {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.split_loggers           = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.status_code_retries     = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.status_code_retry_delay = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.timeout                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] cyborg.version                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.backend               = sqlalchemy {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.connection            = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.connection_debug      = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.connection_parameters =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.connection_recycle_time = 3600 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.connection_trace      = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.db_inc_retry_interval = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.db_max_retries        = 20 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.db_max_retry_interval = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.db_retry_interval     = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.max_overflow          = 50 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.max_pool_size         = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.max_retries           = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.mysql_enable_ndb      = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.mysql_wsrep_sync_wait = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.pool_timeout          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.retry_interval        = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.slave_connection      = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] database.sqlite_synchronous    = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.backend           = sqlalchemy {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.connection        = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.connection_debug  = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.connection_parameters =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.connection_recycle_time = 3600 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.connection_trace  = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.db_inc_retry_interval = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.db_max_retries    = 20 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.db_max_retry_interval = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.db_retry_interval = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.max_overflow      = 50 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.max_pool_size     = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.max_retries       = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.mysql_enable_ndb  = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.pool_timeout      = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.retry_interval    = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.slave_connection  = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] api_database.sqlite_synchronous = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] devices.enabled_mdev_types     = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ephemeral_storage_encryption.enabled = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.api_servers             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.cafile                  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.certfile                = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.collect_timing          = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.connect_retries         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.connect_retry_delay     = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.debug                   = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.default_trusted_certificate_ids = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.enable_certificate_validation = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.enable_rbd_download     = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.endpoint_override       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.insecure                = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.keyfile                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.max_version             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.min_version             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.num_retries             = 3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.rbd_ceph_conf           =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.rbd_connect_timeout     = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.rbd_pool                =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.rbd_user                =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.region_name             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.service_name            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.service_type            = image {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.split_loggers           = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.status_code_retries     = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.status_code_retry_delay = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.timeout                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.verify_glance_signatures = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] glance.version                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] guestfs.debug                  = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.config_drive_cdrom      = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.config_drive_inject_password = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.enable_remotefx         = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.instances_path_share    =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.limit_cpu_features      = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.use_multipath_io        = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.vswitch_name            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] mks.enabled                    = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] image_cache.manager_interval   = 2400 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] image_cache.precache_concurrency = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] image_cache.remove_unused_base_images = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] image_cache.subdirectory_name  = _base {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.api_max_retries         = 60 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.api_retry_interval      = 2 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.auth_section            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.auth_type               = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.cafile                  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.certfile                = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.collect_timing          = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.connect_retries         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.connect_retry_delay     = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.endpoint_override       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.insecure                = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.keyfile                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.max_version             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.min_version             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.partition_key           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.peer_list               = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.region_name             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.serial_console_state_timeout = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.service_name            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.service_type            = baremetal {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.split_loggers           = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.status_code_retries     = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.status_code_retry_delay = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.timeout                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ironic.version                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] key_manager.fixed_key          = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.barbican_api_version  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.barbican_endpoint     = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.barbican_endpoint_type = public {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.barbican_region_name  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.cafile                = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.certfile              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.collect_timing        = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.insecure              = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.keyfile               = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.number_of_retries     = 60 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.retry_delay           = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.send_service_user_token = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.split_loggers         = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.timeout               = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.verify_ssl            = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican.verify_ssl_path       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican_service_user.auth_section = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican_service_user.auth_type = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican_service_user.cafile   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican_service_user.certfile = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican_service_user.collect_timing = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican_service_user.insecure = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican_service_user.keyfile  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican_service_user.split_loggers = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] barbican_service_user.timeout  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.approle_role_id          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.approle_secret_id        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.cafile                   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.certfile                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.collect_timing           = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.insecure                 = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.keyfile                  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.kv_mountpoint            = secret {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.kv_version               = 2 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.namespace                = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.root_token_id            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.split_loggers            = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.ssl_ca_crt_file          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.timeout                  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.use_ssl                  = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.cafile                = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.certfile              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.collect_timing        = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.connect_retries       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.connect_retry_delay   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.endpoint_override     = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.insecure              = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.keyfile               = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.max_version           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.min_version           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.region_name           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.service_name          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.service_type          = identity {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.split_loggers         = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.status_code_retries   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.status_code_retry_delay = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.timeout               = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] keystone.version               = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.connection_uri         =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.cpu_mode               = custom {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: WARNING oslo_config.cfg [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.cpu_power_governor_high = performance {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.cpu_power_management   = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.device_detach_attempts = 8 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.device_detach_timeout  = 20 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.disk_cachemodes        = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.disk_prefix            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.enabled_perf_events    = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.file_backed_memory     = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.gid_maps               = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.hw_disk_discard        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.hw_machine_type        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.images_rbd_pool        = rbd {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.images_type            = default {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.images_volume_group    = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.inject_key             = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.inject_partition       = -2 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.inject_password        = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.iscsi_iface            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.iser_use_multipath     = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_downtime = 500 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_inbound_addr = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_scheme  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_timeout_action = abort {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_tunnelled = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: WARNING oslo_config.cfg [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 26 11:32:38 user nova-compute[73068]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 26 11:32:38 user nova-compute[73068]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 26 11:32:38 user nova-compute[73068]: and ``live_migration_inbound_addr`` respectively.
Aug 26 11:32:38 user nova-compute[73068]: ).  Its value may be silently ignored in the future.
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.live_migration_with_native_tls = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.max_queues             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.nfs_mount_options      = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.num_pcie_ports         = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.pmem_namespaces        = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.quobyte_client_cfg     = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.rbd_secret_uuid        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.rbd_user               = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.rescue_image_id        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.rescue_kernel_id       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.rx_queue_size          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.smbfs_mount_options    =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.snapshot_compression   = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.snapshot_image_format  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.sparse_logical_volumes = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.swtpm_enabled          = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.swtpm_group            = tss {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.swtpm_user             = tss {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.sysinfo_serial         = unique {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.tb_cache_size          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.tx_queue_size          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.uid_maps               = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.use_virtio_for_bridges = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.virt_type              = kvm {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.volume_clear           = zero {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.volume_clear_size      = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.volume_use_multipath   = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.vzstorage_cache_path   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.auth_section           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.auth_type              = password {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.cafile                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.certfile               = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.collect_timing         = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.connect_retries        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.connect_retry_delay    = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.default_floating_pool  = public {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.endpoint_override      = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.extension_sync_interval = 600 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.http_retries           = 3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.insecure               = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.keyfile                = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.max_version            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.min_version            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.ovs_bridge             = br-int {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.physnets               = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.region_name            = RegionOne {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.service_metadata_proxy = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.service_name           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.service_type           = network {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.split_loggers          = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.status_code_retries    = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.status_code_retry_delay = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.timeout                = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] neutron.version                = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] notifications.bdms_in_notifications = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] notifications.default_level    = INFO {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] notifications.notification_format = unversioned {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] notifications.notify_on_state_change = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] pci.alias                      = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] pci.device_spec                = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] pci.report_in_placement        = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.auth_section         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.auth_type            = password {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.cafile               = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.certfile             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.collect_timing       = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.connect_retries      = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.connect_retry_delay  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.default_domain_id    = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.default_domain_name  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.domain_id            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.domain_name          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.endpoint_override    = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.insecure             = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.keyfile              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.max_version          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.min_version          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.password             = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.project_domain_id    = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.project_domain_name  = Default {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.project_id           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.project_name         = service {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.region_name          = RegionOne {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.service_name         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.service_type         = placement {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.split_loggers        = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.status_code_retries  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.status_code_retry_delay = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.system_scope         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.timeout              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.trust_id             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.user_domain_id       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.user_domain_name     = Default {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.user_id              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.username             = placement {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] placement.version              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.cores                    = 20 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.count_usage_from_placement = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.injected_file_content_bytes = 10240 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.injected_file_path_length = 255 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.injected_files           = 5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.instances                = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.key_pairs                = 100 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.metadata_items           = 128 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.ram                      = 51200 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.recheck_quota            = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.server_group_members     = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] quota.server_groups            = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] rdp.enabled                    = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler.image_metadata_prefilter = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler.max_attempts         = 3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler.max_placement_results = 1000 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] scheduler.workers              = 3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.host_subset_size = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.isolated_hosts = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.isolated_images = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:38 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.pci_in_placement = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.track_instance_changes = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] metrics.required               = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] metrics.weight_multiplier      = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] metrics.weight_setting         = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] serial_console.enabled         = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] serial_console.port_range      = 10000:20000 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] serial_console.serialproxy_port = 6083 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] service_user.auth_section      = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] service_user.auth_type         = password {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] service_user.cafile            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] service_user.certfile          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] service_user.collect_timing    = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] service_user.insecure          = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] service_user.keyfile           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] service_user.send_service_user_token = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] service_user.split_loggers     = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] service_user.timeout           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.agent_enabled            = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.enabled                  = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.html5proxy_port          = 6082 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.image_compression        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.jpeg_compression         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.playback_compression     = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.server_listen            = 127.0.0.1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.streaming_mode           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] spice.zlib_compression         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] upgrade_levels.baseapi         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] upgrade_levels.cert            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] upgrade_levels.compute         = auto {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] upgrade_levels.conductor       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] upgrade_levels.scheduler       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vendordata_dynamic_auth.cafile = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vendordata_dynamic_auth.certfile = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vendordata_dynamic_auth.insecure = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vendordata_dynamic_auth.timeout = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.api_retry_count         = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.ca_file                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.cache_prefix            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.cluster_name            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.connection_pool_size    = 10 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.console_delay_seconds   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.datastore_regex         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.host_ip                 = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.host_password           = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.host_port               = 443 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.host_username           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.insecure                = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.integration_bridge      = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.maximum_objects         = 100 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.pbm_default_policy      = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.pbm_enabled             = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.pbm_wsdl_location       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.serial_port_proxy_uri   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.serial_port_service_uri = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.task_poll_interval      = 0.5 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.use_linked_clone        = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.vnc_keymap              = en-us {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.vnc_port                = 5900 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vmware.vnc_port_total          = 10000 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vnc.auth_schemes               = ['none'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vnc.enabled                    = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vnc.novncproxy_port            = 6080 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vnc.vencrypt_ca_certs          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vnc.vencrypt_client_cert       = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vnc.vencrypt_client_key        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.disable_rootwrap   = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.enable_numa_live_migration = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.libvirt_disable_apic = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] wsgi.client_socket_timeout     = 900 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] wsgi.default_pool_size         = 1000 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] wsgi.keep_alive                = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] wsgi.max_header_line           = 16384 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] wsgi.ssl_ca_file               = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] wsgi.ssl_cert_file             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] wsgi.ssl_key_file              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] wsgi.tcp_keepidle              = 600 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] zvm.ca_file                    = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] zvm.cloud_connector_url        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] zvm.reachable_timeout          = 300 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_policy.enforce_new_defaults = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_policy.enforce_scope      = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_policy.policy_default_rule = default {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler.connection_string     = messaging:// {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler.enabled               = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler.es_doc_type           = notification {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler.es_scroll_size        = 10000 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler.es_scroll_time        = 2m {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler.filter_error_trace    = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler.hmac_keys             = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler.sentinel_service_name = mymaster {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler.socket_timeout        = 0.1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler.trace_requests        = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler.trace_sqlalchemy      = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler_jaeger.process_tags   = {} {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler_jaeger.service_name_prefix = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] profiler_otlp.service_name_prefix = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] remote_debug.host              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] remote_debug.port              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_notifications.retry = -1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.auth_section        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.auth_type           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.cafile              = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.certfile            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.collect_timing      = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.connect_retries     = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.connect_retry_delay = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.endpoint_id         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.endpoint_override   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.insecure            = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.keyfile             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.max_version         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.min_version         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.region_name         = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.service_name        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.service_type        = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.split_loggers       = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.status_code_retries = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.status_code_retry_delay = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.timeout             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.valid_interfaces    = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_limit.version             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_reports.file_event_handler = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] oslo_reports.log_dir           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_ovs_privileged.group  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] vif_plug_ovs_privileged.user   = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_ovs.isolate_vif         = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] os_brick.lock_path             = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] privsep_osbrick.capabilities   = [21] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] privsep_osbrick.group          = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] privsep_osbrick.helper_command = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] privsep_osbrick.user           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] nova_sys_admin.group           = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] nova_sys_admin.helper_command  = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] nova_sys_admin.user            = None {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG oslo_service.service [None req-87678c8c-606c-4d42-b3d4-4d3824ade807 None None] ******************************************************************************** {{(pid=73068) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 26 11:32:39 user nova-compute[73068]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 26 11:32:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Starting native event thread {{(pid=73068) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Starting green dispatch thread {{(pid=73068) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Starting connection event dispatch thread {{(pid=73068) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Connecting to libvirt: qemu:///system {{(pid=73068) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fddb43ee7d0> {{(pid=73068) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 26 11:32:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fddb43ee7d0> {{(pid=73068) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 26 11:32:39 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Connection event '1' reason 'None'
Aug 26 11:32:39 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 11:32:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.mount [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Initialising _HostMountState generation 0 {{(pid=73068) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 26 11:32:46 user nova-compute[73068]: INFO nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Libvirt host capabilities <capabilities>
Aug 26 11:32:46 user nova-compute[73068]:   <host>
Aug 26 11:32:46 user nova-compute[73068]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 26 11:32:46 user nova-compute[73068]:     <cpu>
Aug 26 11:32:46 user nova-compute[73068]:       <arch>x86_64</arch>
Aug 26 11:32:46 user nova-compute[73068]:       <model>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <vendor>Intel</vendor>
Aug 26 11:32:46 user nova-compute[73068]:       <microcode version='1070'/>
Aug 26 11:32:46 user nova-compute[73068]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 26 11:32:46 user nova-compute[73068]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='ss'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='vmx'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='pcid'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='osxsave'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='hypervisor'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='arat'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='tsc_adjust'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='md-clear'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='arch-capabilities'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='invtsc'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='rsba'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature name='skip-l1dfl-vmentry'/>
Aug 26 11:32:46 user nova-compute[73068]:       <pages unit='KiB' size='4'/>
Aug 26 11:32:46 user nova-compute[73068]:       <pages unit='KiB' size='2048'/>
Aug 26 11:32:46 user nova-compute[73068]:     </cpu>
Aug 26 11:32:46 user nova-compute[73068]:     <power_management>
Aug 26 11:32:46 user nova-compute[73068]:       <suspend_mem/>
Aug 26 11:32:46 user nova-compute[73068]:       <suspend_disk/>
Aug 26 11:32:46 user nova-compute[73068]:       <suspend_hybrid/>
Aug 26 11:32:46 user nova-compute[73068]:     </power_management>
Aug 26 11:32:46 user nova-compute[73068]:     <iommu support='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     <migration_features>
Aug 26 11:32:46 user nova-compute[73068]:       <live/>
Aug 26 11:32:46 user nova-compute[73068]:       <uri_transports>
Aug 26 11:32:46 user nova-compute[73068]:         <uri_transport>tcp</uri_transport>
Aug 26 11:32:46 user nova-compute[73068]:         <uri_transport>rdma</uri_transport>
Aug 26 11:32:46 user nova-compute[73068]:       </uri_transports>
Aug 26 11:32:46 user nova-compute[73068]:     </migration_features>
Aug 26 11:32:46 user nova-compute[73068]:     <topology>
Aug 26 11:32:46 user nova-compute[73068]:       <cells num='2'>
Aug 26 11:32:46 user nova-compute[73068]:         <cell id='0'>
Aug 26 11:32:46 user nova-compute[73068]:           <memory unit='KiB'>8140616</memory>
Aug 26 11:32:46 user nova-compute[73068]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 26 11:32:46 user nova-compute[73068]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 11:32:46 user nova-compute[73068]:           <distances>
Aug 26 11:32:46 user nova-compute[73068]:             <sibling id='0' value='10'/>
Aug 26 11:32:46 user nova-compute[73068]:             <sibling id='1' value='20'/>
Aug 26 11:32:46 user nova-compute[73068]:           </distances>
Aug 26 11:32:46 user nova-compute[73068]:           <cpus num='6'>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 26 11:32:46 user nova-compute[73068]:           </cpus>
Aug 26 11:32:46 user nova-compute[73068]:         </cell>
Aug 26 11:32:46 user nova-compute[73068]:         <cell id='1'>
Aug 26 11:32:46 user nova-compute[73068]:           <memory unit='KiB'>8255068</memory>
Aug 26 11:32:46 user nova-compute[73068]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 26 11:32:46 user nova-compute[73068]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 11:32:46 user nova-compute[73068]:           <distances>
Aug 26 11:32:46 user nova-compute[73068]:             <sibling id='0' value='20'/>
Aug 26 11:32:46 user nova-compute[73068]:             <sibling id='1' value='10'/>
Aug 26 11:32:46 user nova-compute[73068]:           </distances>
Aug 26 11:32:46 user nova-compute[73068]:           <cpus num='6'>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 26 11:32:46 user nova-compute[73068]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 26 11:32:46 user nova-compute[73068]:           </cpus>
Aug 26 11:32:46 user nova-compute[73068]:         </cell>
Aug 26 11:32:46 user nova-compute[73068]:       </cells>
Aug 26 11:32:46 user nova-compute[73068]:     </topology>
Aug 26 11:32:46 user nova-compute[73068]:     <cache>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 26 11:32:46 user nova-compute[73068]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 26 11:32:46 user nova-compute[73068]:     </cache>
Aug 26 11:32:46 user nova-compute[73068]:     <secmodel>
Aug 26 11:32:46 user nova-compute[73068]:       <model>apparmor</model>
Aug 26 11:32:46 user nova-compute[73068]:       <doi>0</doi>
Aug 26 11:32:46 user nova-compute[73068]:     </secmodel>
Aug 26 11:32:46 user nova-compute[73068]:     <secmodel>
Aug 26 11:32:46 user nova-compute[73068]:       <model>dac</model>
Aug 26 11:32:46 user nova-compute[73068]:       <doi>0</doi>
Aug 26 11:32:46 user nova-compute[73068]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 26 11:32:46 user nova-compute[73068]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 26 11:32:46 user nova-compute[73068]:     </secmodel>
Aug 26 11:32:46 user nova-compute[73068]:   </host>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='alpha'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>64</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>clipper</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='armv6l'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>spitz</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>nuri</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>kzm</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sx1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>z2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>tosa</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>n810</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>n800</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>terrier</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>midway</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>microbit</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>verdex</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>highbank</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>akita</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>connex</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>collie</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='armv7l'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>spitz</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>nuri</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>kzm</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sx1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>z2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>tosa</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>n810</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>n800</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>terrier</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>midway</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>microbit</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>verdex</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>highbank</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>akita</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>connex</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>collie</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='aarch64'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>64</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>spitz</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>nuri</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>kzm</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sx1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>z2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>tosa</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>n810</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>n800</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>terrier</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>midway</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>microbit</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>verdex</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>raspi3b</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>highbank</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>akita</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>connex</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>collie</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <acpi default='on' toggle='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='cris'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='i686'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>isapc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>microvm</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='kvm'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <pae/>
Aug 26 11:32:46 user nova-compute[73068]:       <nonpae/>
Aug 26 11:32:46 user nova-compute[73068]:       <acpi default='on' toggle='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:       <apic default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='m68k'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>an5206</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>q800</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>next-cube</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='microblaze'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='microblazeel'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='mips'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='16'>malta</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='mipsel'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='16'>malta</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='mips64'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>64</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='16'>malta</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>pica61</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>magnum</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='mips64el'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>64</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='16'>malta</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>pica61</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>magnum</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='16'>boston</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='ppc'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mac99</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>40p</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>taihu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='ppc64'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>64</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>taihu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>40p</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mac99</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='ppc64le'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>64</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>taihu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>40p</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>mac99</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='riscv32'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='8'>spike</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>opentitan</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='8'>virt</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='riscv64'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>64</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='8'>spike</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>shakti_c</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='8'>virt</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='s390x'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>64</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='sh4'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>shix</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>r2d</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='sh4eb'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>64</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>shix</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>r2d</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='sparc'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>SS-5</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>SS-20</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>LX</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>SS-4</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>SS-10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>Voyager</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='sparc64'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>64</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sun4u</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>niagara</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>sun4v</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='x86_64'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>64</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='1'>isapc</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>microvm</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='kvm'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <acpi default='on' toggle='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:       <apic default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='xtensa'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>sim</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>kc705</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>ml605</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>virt</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>lx200</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>lx60</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]:   <guest>
Aug 26 11:32:46 user nova-compute[73068]:     <os_type>hvm</os_type>
Aug 26 11:32:46 user nova-compute[73068]:     <arch name='xtensaeb'>
Aug 26 11:32:46 user nova-compute[73068]:       <wordsize>32</wordsize>
Aug 26 11:32:46 user nova-compute[73068]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='4'>sim</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>kc705</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>ml605</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>virt</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>lx200</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>lx60</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 11:32:46 user nova-compute[73068]:       <domain type='qemu'/>
Aug 26 11:32:46 user nova-compute[73068]:     </arch>
Aug 26 11:32:46 user nova-compute[73068]:     <features>
Aug 26 11:32:46 user nova-compute[73068]:       <cpuselection/>
Aug 26 11:32:46 user nova-compute[73068]:       <deviceboot/>
Aug 26 11:32:46 user nova-compute[73068]:       <disksnapshot default='on' toggle='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     </features>
Aug 26 11:32:46 user nova-compute[73068]:   </guest>
Aug 26 11:32:46 user nova-compute[73068]: </capabilities>
Aug 26 11:32:46 user nova-compute[73068]: 
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 26 11:32:46 user nova-compute[73068]: <domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 11:32:46 user nova-compute[73068]:   <domain>kvm</domain>
Aug 26 11:32:46 user nova-compute[73068]:   <machine>pc-q35-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:   <arch>i686</arch>
Aug 26 11:32:46 user nova-compute[73068]:   <vcpu max='288'/>
Aug 26 11:32:46 user nova-compute[73068]:   <iothreads supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:   <os supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='firmware'/>
Aug 26 11:32:46 user nova-compute[73068]:     <loader supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>rom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pflash</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='readonly'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>yes</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='secure'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </loader>
Aug 26 11:32:46 user nova-compute[73068]:   </os>
Aug 26 11:32:46 user nova-compute[73068]:   <cpu>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-passthrough' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='hostPassthroughMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='maximum' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='maximumMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-model' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <vendor>Intel</vendor>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ss'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='vmx'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pcid'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='hypervisor'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arat'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='umip'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='md-clear'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibpb'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibrs'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='erms'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='lm'/>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='custom' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>qemu64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>qemu32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>phenom</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>n270</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>kvm64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>coreduo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>core2duo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>athlon</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Westmere</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Snowridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Penryn</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G5</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G4</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G1</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Nehalem</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Rome</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Milan</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Dhyana</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cooperlake</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Conroe</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>486</model>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:   </cpu>
Aug 26 11:32:46 user nova-compute[73068]:   <memoryBacking supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='sourceType'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>file</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>anonymous</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>memfd</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:   </memoryBacking>
Aug 26 11:32:46 user nova-compute[73068]:   <devices>
Aug 26 11:32:46 user nova-compute[73068]:     <disk supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='diskDevice'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>disk</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cdrom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>floppy</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>lun</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='bus'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>fdc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sata</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </disk>
Aug 26 11:32:46 user nova-compute[73068]:     <graphics supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sdl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vnc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>spice</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egl-headless</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </graphics>
Aug 26 11:32:46 user nova-compute[73068]:     <video supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='modelType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cirrus</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vmvga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>qxl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>none</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>bochs</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ramfb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </video>
Aug 26 11:32:46 user nova-compute[73068]:     <hostdev supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='mode'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>subsystem</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='startupPolicy'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>default</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>mandatory</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>requisite</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>optional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='subsysType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pci</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='capsType'/>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='pciBackend'/>
Aug 26 11:32:46 user nova-compute[73068]:     </hostdev>
Aug 26 11:32:46 user nova-compute[73068]:     <rng supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>random</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egd</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>builtin</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </rng>
Aug 26 11:32:46 user nova-compute[73068]:     <filesystem supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='driverType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>path</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>handle</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtiofs</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </filesystem>
Aug 26 11:32:46 user nova-compute[73068]:     <tpm supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-tis</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-crb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>passthrough</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>emulator</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </tpm>
Aug 26 11:32:46 user nova-compute[73068]:   </devices>
Aug 26 11:32:46 user nova-compute[73068]:   <features>
Aug 26 11:32:46 user nova-compute[73068]:     <gic supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     <vmcoreinfo supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <genid supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backingStoreInput supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backup supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <sev supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:   </features>
Aug 26 11:32:46 user nova-compute[73068]: </domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:  {{(pid=73068) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 26 11:32:46 user nova-compute[73068]: <domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 11:32:46 user nova-compute[73068]:   <domain>kvm</domain>
Aug 26 11:32:46 user nova-compute[73068]:   <machine>pc-q35-jammy</machine>
Aug 26 11:32:46 user nova-compute[73068]:   <arch>i686</arch>
Aug 26 11:32:46 user nova-compute[73068]:   <vcpu max='288'/>
Aug 26 11:32:46 user nova-compute[73068]:   <iothreads supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:   <os supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='firmware'/>
Aug 26 11:32:46 user nova-compute[73068]:     <loader supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>rom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pflash</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='readonly'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>yes</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='secure'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </loader>
Aug 26 11:32:46 user nova-compute[73068]:   </os>
Aug 26 11:32:46 user nova-compute[73068]:   <cpu>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-passthrough' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='hostPassthroughMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='maximum' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='maximumMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-model' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <vendor>Intel</vendor>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ss'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='vmx'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pcid'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='hypervisor'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arat'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='umip'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='md-clear'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibpb'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibrs'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='erms'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='lm'/>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='custom' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>qemu64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>qemu32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>phenom</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>n270</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>kvm64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>coreduo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>core2duo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>athlon</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Westmere</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Snowridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Penryn</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G5</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G4</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G1</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Nehalem</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Rome</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Milan</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Dhyana</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cooperlake</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Conroe</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>486</model>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:   </cpu>
Aug 26 11:32:46 user nova-compute[73068]:   <memoryBacking supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='sourceType'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>file</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>anonymous</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>memfd</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:   </memoryBacking>
Aug 26 11:32:46 user nova-compute[73068]:   <devices>
Aug 26 11:32:46 user nova-compute[73068]:     <disk supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='diskDevice'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>disk</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cdrom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>floppy</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>lun</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='bus'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>fdc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sata</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </disk>
Aug 26 11:32:46 user nova-compute[73068]:     <graphics supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sdl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vnc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>spice</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egl-headless</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </graphics>
Aug 26 11:32:46 user nova-compute[73068]:     <video supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='modelType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cirrus</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vmvga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>qxl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>none</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>bochs</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ramfb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </video>
Aug 26 11:32:46 user nova-compute[73068]:     <hostdev supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='mode'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>subsystem</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='startupPolicy'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>default</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>mandatory</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>requisite</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>optional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='subsysType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pci</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='capsType'/>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='pciBackend'/>
Aug 26 11:32:46 user nova-compute[73068]:     </hostdev>
Aug 26 11:32:46 user nova-compute[73068]:     <rng supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>random</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egd</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>builtin</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </rng>
Aug 26 11:32:46 user nova-compute[73068]:     <filesystem supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='driverType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>path</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>handle</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtiofs</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </filesystem>
Aug 26 11:32:46 user nova-compute[73068]:     <tpm supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-tis</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-crb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>passthrough</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>emulator</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </tpm>
Aug 26 11:32:46 user nova-compute[73068]:   </devices>
Aug 26 11:32:46 user nova-compute[73068]:   <features>
Aug 26 11:32:46 user nova-compute[73068]:     <gic supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     <vmcoreinfo supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <genid supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backingStoreInput supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backup supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <sev supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:   </features>
Aug 26 11:32:46 user nova-compute[73068]: </domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:  {{(pid=73068) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 26 11:32:46 user nova-compute[73068]: <domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 11:32:46 user nova-compute[73068]:   <domain>kvm</domain>
Aug 26 11:32:46 user nova-compute[73068]:   <machine>pc-i440fx-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:   <arch>i686</arch>
Aug 26 11:32:46 user nova-compute[73068]:   <vcpu max='255'/>
Aug 26 11:32:46 user nova-compute[73068]:   <iothreads supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:   <os supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='firmware'/>
Aug 26 11:32:46 user nova-compute[73068]:     <loader supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>rom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pflash</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='readonly'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>yes</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='secure'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </loader>
Aug 26 11:32:46 user nova-compute[73068]:   </os>
Aug 26 11:32:46 user nova-compute[73068]:   <cpu>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-passthrough' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='hostPassthroughMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='maximum' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='maximumMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-model' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <vendor>Intel</vendor>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ss'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='vmx'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pcid'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='hypervisor'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arat'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='umip'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='md-clear'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibpb'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibrs'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='erms'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='lm'/>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='custom' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>qemu64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>qemu32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>phenom</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>n270</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>kvm64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>coreduo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>core2duo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>athlon</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Westmere</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Snowridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Penryn</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G5</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G4</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G1</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Nehalem</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Rome</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Milan</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Dhyana</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cooperlake</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Conroe</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>486</model>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:   </cpu>
Aug 26 11:32:46 user nova-compute[73068]:   <memoryBacking supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='sourceType'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>file</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>anonymous</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>memfd</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:   </memoryBacking>
Aug 26 11:32:46 user nova-compute[73068]:   <devices>
Aug 26 11:32:46 user nova-compute[73068]:     <disk supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='diskDevice'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>disk</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cdrom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>floppy</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>lun</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='bus'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ide</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>fdc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sata</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </disk>
Aug 26 11:32:46 user nova-compute[73068]:     <graphics supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sdl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vnc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>spice</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egl-headless</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </graphics>
Aug 26 11:32:46 user nova-compute[73068]:     <video supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='modelType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cirrus</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vmvga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>qxl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>none</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>bochs</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ramfb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </video>
Aug 26 11:32:46 user nova-compute[73068]:     <hostdev supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='mode'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>subsystem</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='startupPolicy'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>default</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>mandatory</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>requisite</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>optional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='subsysType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pci</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='capsType'/>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='pciBackend'/>
Aug 26 11:32:46 user nova-compute[73068]:     </hostdev>
Aug 26 11:32:46 user nova-compute[73068]:     <rng supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>random</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egd</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>builtin</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </rng>
Aug 26 11:32:46 user nova-compute[73068]:     <filesystem supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='driverType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>path</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>handle</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtiofs</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </filesystem>
Aug 26 11:32:46 user nova-compute[73068]:     <tpm supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-tis</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-crb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>passthrough</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>emulator</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </tpm>
Aug 26 11:32:46 user nova-compute[73068]:   </devices>
Aug 26 11:32:46 user nova-compute[73068]:   <features>
Aug 26 11:32:46 user nova-compute[73068]:     <gic supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     <vmcoreinfo supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <genid supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backingStoreInput supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backup supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <sev supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:   </features>
Aug 26 11:32:46 user nova-compute[73068]: </domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:  {{(pid=73068) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 26 11:32:46 user nova-compute[73068]: <domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 11:32:46 user nova-compute[73068]:   <domain>kvm</domain>
Aug 26 11:32:46 user nova-compute[73068]:   <machine>pc-i440fx-jammy</machine>
Aug 26 11:32:46 user nova-compute[73068]:   <arch>i686</arch>
Aug 26 11:32:46 user nova-compute[73068]:   <vcpu max='255'/>
Aug 26 11:32:46 user nova-compute[73068]:   <iothreads supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:   <os supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='firmware'/>
Aug 26 11:32:46 user nova-compute[73068]:     <loader supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>rom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pflash</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='readonly'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>yes</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='secure'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </loader>
Aug 26 11:32:46 user nova-compute[73068]:   </os>
Aug 26 11:32:46 user nova-compute[73068]:   <cpu>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-passthrough' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='hostPassthroughMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='maximum' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='maximumMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-model' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <vendor>Intel</vendor>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ss'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='vmx'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pcid'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='hypervisor'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arat'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='umip'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='md-clear'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibpb'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibrs'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='erms'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='lm'/>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='custom' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>qemu64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>qemu32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>phenom</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>n270</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>kvm64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>coreduo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>core2duo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>athlon</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Westmere</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Snowridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Penryn</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G5</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G4</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G1</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Nehalem</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Rome</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Milan</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Dhyana</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cooperlake</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Conroe</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>486</model>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:   </cpu>
Aug 26 11:32:46 user nova-compute[73068]:   <memoryBacking supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='sourceType'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>file</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>anonymous</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>memfd</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:   </memoryBacking>
Aug 26 11:32:46 user nova-compute[73068]:   <devices>
Aug 26 11:32:46 user nova-compute[73068]:     <disk supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='diskDevice'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>disk</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cdrom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>floppy</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>lun</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='bus'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ide</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>fdc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sata</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </disk>
Aug 26 11:32:46 user nova-compute[73068]:     <graphics supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sdl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vnc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>spice</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egl-headless</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </graphics>
Aug 26 11:32:46 user nova-compute[73068]:     <video supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='modelType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cirrus</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vmvga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>qxl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>none</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>bochs</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ramfb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </video>
Aug 26 11:32:46 user nova-compute[73068]:     <hostdev supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='mode'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>subsystem</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='startupPolicy'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>default</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>mandatory</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>requisite</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>optional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='subsysType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pci</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='capsType'/>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='pciBackend'/>
Aug 26 11:32:46 user nova-compute[73068]:     </hostdev>
Aug 26 11:32:46 user nova-compute[73068]:     <rng supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>random</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egd</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>builtin</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </rng>
Aug 26 11:32:46 user nova-compute[73068]:     <filesystem supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='driverType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>path</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>handle</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtiofs</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </filesystem>
Aug 26 11:32:46 user nova-compute[73068]:     <tpm supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-tis</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-crb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>passthrough</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>emulator</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </tpm>
Aug 26 11:32:46 user nova-compute[73068]:   </devices>
Aug 26 11:32:46 user nova-compute[73068]:   <features>
Aug 26 11:32:46 user nova-compute[73068]:     <gic supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     <vmcoreinfo supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <genid supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backingStoreInput supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backup supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <sev supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:   </features>
Aug 26 11:32:46 user nova-compute[73068]: </domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:  {{(pid=73068) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 26 11:32:46 user nova-compute[73068]: <domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 11:32:46 user nova-compute[73068]:   <domain>kvm</domain>
Aug 26 11:32:46 user nova-compute[73068]:   <machine>pc-q35-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:   <arch>x86_64</arch>
Aug 26 11:32:46 user nova-compute[73068]:   <vcpu max='288'/>
Aug 26 11:32:46 user nova-compute[73068]:   <iothreads supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:   <os supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='firmware'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>efi</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:     <loader supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>rom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pflash</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='readonly'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>yes</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='secure'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>yes</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </loader>
Aug 26 11:32:46 user nova-compute[73068]:   </os>
Aug 26 11:32:46 user nova-compute[73068]:   <cpu>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-passthrough' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='hostPassthroughMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='maximum' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='maximumMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-model' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <vendor>Intel</vendor>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ss'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='vmx'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pcid'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='hypervisor'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arat'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='umip'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='md-clear'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='invtsc'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibpb'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibrs'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='rsba'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='erms'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='custom' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>qemu64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>qemu32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>phenom</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>n270</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>coreduo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>core2duo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>athlon</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Westmere</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Snowridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Penryn</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G5</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G4</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Opteron_G1</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Nehalem</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Rome</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Milan</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Dhyana</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cooperlake</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Conroe</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>486</model>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:   </cpu>
Aug 26 11:32:46 user nova-compute[73068]:   <memoryBacking supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='sourceType'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>file</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>anonymous</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>memfd</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:   </memoryBacking>
Aug 26 11:32:46 user nova-compute[73068]:   <devices>
Aug 26 11:32:46 user nova-compute[73068]:     <disk supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='diskDevice'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>disk</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cdrom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>floppy</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>lun</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='bus'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>fdc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sata</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </disk>
Aug 26 11:32:46 user nova-compute[73068]:     <graphics supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sdl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vnc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>spice</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egl-headless</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </graphics>
Aug 26 11:32:46 user nova-compute[73068]:     <video supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='modelType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cirrus</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vmvga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>qxl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>none</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>bochs</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ramfb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </video>
Aug 26 11:32:46 user nova-compute[73068]:     <hostdev supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='mode'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>subsystem</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='startupPolicy'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>default</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>mandatory</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>requisite</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>optional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='subsysType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pci</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='capsType'/>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='pciBackend'/>
Aug 26 11:32:46 user nova-compute[73068]:     </hostdev>
Aug 26 11:32:46 user nova-compute[73068]:     <rng supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>random</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egd</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>builtin</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </rng>
Aug 26 11:32:46 user nova-compute[73068]:     <filesystem supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='driverType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>path</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>handle</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtiofs</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </filesystem>
Aug 26 11:32:46 user nova-compute[73068]:     <tpm supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-tis</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-crb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>passthrough</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>emulator</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </tpm>
Aug 26 11:32:46 user nova-compute[73068]:   </devices>
Aug 26 11:32:46 user nova-compute[73068]:   <features>
Aug 26 11:32:46 user nova-compute[73068]:     <gic supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     <vmcoreinfo supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <genid supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backingStoreInput supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backup supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <sev supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:   </features>
Aug 26 11:32:46 user nova-compute[73068]: </domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:  {{(pid=73068) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 26 11:32:46 user nova-compute[73068]: <domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 11:32:46 user nova-compute[73068]:   <domain>kvm</domain>
Aug 26 11:32:46 user nova-compute[73068]:   <machine>pc-q35-jammy</machine>
Aug 26 11:32:46 user nova-compute[73068]:   <arch>x86_64</arch>
Aug 26 11:32:46 user nova-compute[73068]:   <vcpu max='288'/>
Aug 26 11:32:46 user nova-compute[73068]:   <iothreads supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:   <os supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='firmware'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>efi</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:     <loader supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>rom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pflash</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='readonly'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>yes</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='secure'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>yes</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </loader>
Aug 26 11:32:46 user nova-compute[73068]:   </os>
Aug 26 11:32:46 user nova-compute[73068]:   <cpu>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-passthrough' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='hostPassthroughMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='maximum' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='maximumMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-model' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <vendor>Intel</vendor>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ss'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='vmx'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pcid'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='hypervisor'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arat'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='umip'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='md-clear'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='invtsc'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibpb'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibrs'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='rsba'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='erms'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='custom' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>qemu64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>qemu32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>phenom</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>n270</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>coreduo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>core2duo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>athlon</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Westmere</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Snowridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Penryn</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G5</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G4</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Opteron_G1</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Nehalem</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Rome</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Milan</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Dhyana</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cooperlake</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Conroe</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>486</model>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:   </cpu>
Aug 26 11:32:46 user nova-compute[73068]:   <memoryBacking supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='sourceType'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>file</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>anonymous</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>memfd</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:   </memoryBacking>
Aug 26 11:32:46 user nova-compute[73068]:   <devices>
Aug 26 11:32:46 user nova-compute[73068]:     <disk supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='diskDevice'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>disk</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cdrom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>floppy</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>lun</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='bus'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>fdc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sata</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </disk>
Aug 26 11:32:46 user nova-compute[73068]:     <graphics supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sdl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vnc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>spice</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egl-headless</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </graphics>
Aug 26 11:32:46 user nova-compute[73068]:     <video supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='modelType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cirrus</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vmvga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>qxl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>none</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>bochs</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ramfb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </video>
Aug 26 11:32:46 user nova-compute[73068]:     <hostdev supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='mode'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>subsystem</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='startupPolicy'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>default</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>mandatory</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>requisite</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>optional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='subsysType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pci</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='capsType'/>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='pciBackend'/>
Aug 26 11:32:46 user nova-compute[73068]:     </hostdev>
Aug 26 11:32:46 user nova-compute[73068]:     <rng supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>random</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egd</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>builtin</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </rng>
Aug 26 11:32:46 user nova-compute[73068]:     <filesystem supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='driverType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>path</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>handle</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtiofs</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </filesystem>
Aug 26 11:32:46 user nova-compute[73068]:     <tpm supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-tis</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-crb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>passthrough</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>emulator</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </tpm>
Aug 26 11:32:46 user nova-compute[73068]:   </devices>
Aug 26 11:32:46 user nova-compute[73068]:   <features>
Aug 26 11:32:46 user nova-compute[73068]:     <gic supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     <vmcoreinfo supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <genid supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backingStoreInput supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backup supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <sev supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:   </features>
Aug 26 11:32:46 user nova-compute[73068]: </domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:  {{(pid=73068) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 26 11:32:46 user nova-compute[73068]: <domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 11:32:46 user nova-compute[73068]:   <domain>kvm</domain>
Aug 26 11:32:46 user nova-compute[73068]:   <machine>pc-i440fx-6.2</machine>
Aug 26 11:32:46 user nova-compute[73068]:   <arch>x86_64</arch>
Aug 26 11:32:46 user nova-compute[73068]:   <vcpu max='255'/>
Aug 26 11:32:46 user nova-compute[73068]:   <iothreads supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:   <os supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='firmware'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>efi</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:     <loader supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>rom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pflash</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='readonly'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>yes</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='secure'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </loader>
Aug 26 11:32:46 user nova-compute[73068]:   </os>
Aug 26 11:32:46 user nova-compute[73068]:   <cpu>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-passthrough' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='hostPassthroughMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='maximum' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='maximumMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-model' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <vendor>Intel</vendor>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ss'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='vmx'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pcid'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='hypervisor'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arat'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='umip'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='md-clear'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='invtsc'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibpb'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibrs'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='rsba'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='erms'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='custom' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>qemu64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>qemu32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>phenom</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>n270</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>coreduo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>core2duo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>athlon</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Westmere</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Snowridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Penryn</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G5</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G4</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Opteron_G1</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Nehalem</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Rome</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Milan</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Dhyana</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cooperlake</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Conroe</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>486</model>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:   </cpu>
Aug 26 11:32:46 user nova-compute[73068]:   <memoryBacking supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='sourceType'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>file</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>anonymous</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>memfd</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:   </memoryBacking>
Aug 26 11:32:46 user nova-compute[73068]:   <devices>
Aug 26 11:32:46 user nova-compute[73068]:     <disk supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='diskDevice'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>disk</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cdrom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>floppy</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>lun</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='bus'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ide</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>fdc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sata</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </disk>
Aug 26 11:32:46 user nova-compute[73068]:     <graphics supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sdl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vnc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>spice</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egl-headless</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </graphics>
Aug 26 11:32:46 user nova-compute[73068]:     <video supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='modelType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cirrus</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vmvga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>qxl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>none</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>bochs</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ramfb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </video>
Aug 26 11:32:46 user nova-compute[73068]:     <hostdev supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='mode'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>subsystem</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='startupPolicy'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>default</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>mandatory</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>requisite</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>optional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='subsysType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pci</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='capsType'/>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='pciBackend'/>
Aug 26 11:32:46 user nova-compute[73068]:     </hostdev>
Aug 26 11:32:46 user nova-compute[73068]:     <rng supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>random</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egd</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>builtin</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </rng>
Aug 26 11:32:46 user nova-compute[73068]:     <filesystem supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='driverType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>path</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>handle</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtiofs</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </filesystem>
Aug 26 11:32:46 user nova-compute[73068]:     <tpm supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-tis</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-crb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>passthrough</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>emulator</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </tpm>
Aug 26 11:32:46 user nova-compute[73068]:   </devices>
Aug 26 11:32:46 user nova-compute[73068]:   <features>
Aug 26 11:32:46 user nova-compute[73068]:     <gic supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     <vmcoreinfo supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <genid supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backingStoreInput supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backup supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <sev supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:   </features>
Aug 26 11:32:46 user nova-compute[73068]: </domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:  {{(pid=73068) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 26 11:32:46 user nova-compute[73068]: <domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 11:32:46 user nova-compute[73068]:   <domain>kvm</domain>
Aug 26 11:32:46 user nova-compute[73068]:   <machine>pc-i440fx-jammy</machine>
Aug 26 11:32:46 user nova-compute[73068]:   <arch>x86_64</arch>
Aug 26 11:32:46 user nova-compute[73068]:   <vcpu max='255'/>
Aug 26 11:32:46 user nova-compute[73068]:   <iothreads supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:   <os supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='firmware'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>efi</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:     <loader supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>rom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pflash</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='readonly'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>yes</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='secure'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>no</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </loader>
Aug 26 11:32:46 user nova-compute[73068]:   </os>
Aug 26 11:32:46 user nova-compute[73068]:   <cpu>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-passthrough' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='hostPassthroughMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='maximum' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='maximumMigratable'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>on</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>off</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='host-model' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <vendor>Intel</vendor>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ss'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='vmx'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pcid'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='hypervisor'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arat'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='umip'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='md-clear'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='invtsc'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibpb'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='ibrs'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-stibp'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='rsba'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='erms'/>
Aug 26 11:32:46 user nova-compute[73068]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:     <mode name='custom' supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>qemu64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>qemu32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>phenom</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>pentium</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>n270</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm64</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>kvm32</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>coreduo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>core2duo</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>athlon</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Westmere</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Snowridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Skylake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>SandyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Penryn</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G5</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G4</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G3</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Opteron_G2</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Opteron_G1</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Nehalem</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>IvyBridge</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Icelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Haswell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Rome</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-Milan</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>EPYC</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Dhyana</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cooperlake</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>Conroe</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='no'>Broadwell</model>
Aug 26 11:32:46 user nova-compute[73068]:       <model usable='yes'>486</model>
Aug 26 11:32:46 user nova-compute[73068]:     </mode>
Aug 26 11:32:46 user nova-compute[73068]:   </cpu>
Aug 26 11:32:46 user nova-compute[73068]:   <memoryBacking supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:     <enum name='sourceType'>
Aug 26 11:32:46 user nova-compute[73068]:       <value>file</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>anonymous</value>
Aug 26 11:32:46 user nova-compute[73068]:       <value>memfd</value>
Aug 26 11:32:46 user nova-compute[73068]:     </enum>
Aug 26 11:32:46 user nova-compute[73068]:   </memoryBacking>
Aug 26 11:32:46 user nova-compute[73068]:   <devices>
Aug 26 11:32:46 user nova-compute[73068]:     <disk supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='diskDevice'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>disk</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cdrom</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>floppy</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>lun</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='bus'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ide</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>fdc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sata</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </disk>
Aug 26 11:32:46 user nova-compute[73068]:     <graphics supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='type'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>sdl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vnc</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>spice</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egl-headless</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </graphics>
Aug 26 11:32:46 user nova-compute[73068]:     <video supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='modelType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>cirrus</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>vmvga</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>qxl</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>none</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>bochs</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>ramfb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </video>
Aug 26 11:32:46 user nova-compute[73068]:     <hostdev supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='mode'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>subsystem</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='startupPolicy'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>default</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>mandatory</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>requisite</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>optional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='subsysType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>usb</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>pci</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>scsi</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='capsType'/>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='pciBackend'/>
Aug 26 11:32:46 user nova-compute[73068]:     </hostdev>
Aug 26 11:32:46 user nova-compute[73068]:     <rng supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtio-non-transitional</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>random</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>egd</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>builtin</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </rng>
Aug 26 11:32:46 user nova-compute[73068]:     <filesystem supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='driverType'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>path</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>handle</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>virtiofs</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </filesystem>
Aug 26 11:32:46 user nova-compute[73068]:     <tpm supported='yes'>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='model'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-tis</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>tpm-crb</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:       <enum name='backendModel'>
Aug 26 11:32:46 user nova-compute[73068]:         <value>passthrough</value>
Aug 26 11:32:46 user nova-compute[73068]:         <value>emulator</value>
Aug 26 11:32:46 user nova-compute[73068]:       </enum>
Aug 26 11:32:46 user nova-compute[73068]:     </tpm>
Aug 26 11:32:46 user nova-compute[73068]:   </devices>
Aug 26 11:32:46 user nova-compute[73068]:   <features>
Aug 26 11:32:46 user nova-compute[73068]:     <gic supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:     <vmcoreinfo supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <genid supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backingStoreInput supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <backup supported='yes'/>
Aug 26 11:32:46 user nova-compute[73068]:     <sev supported='no'/>
Aug 26 11:32:46 user nova-compute[73068]:   </features>
Aug 26 11:32:46 user nova-compute[73068]: </domainCapabilities>
Aug 26 11:32:46 user nova-compute[73068]:  {{(pid=73068) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73068) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73068) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Checking secure boot support for host arch (x86_64) {{(pid=73068) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 11:32:46 user nova-compute[73068]: INFO nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Secure Boot support detected
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] cpu compare xml: <cpu match="exact">
Aug 26 11:32:46 user nova-compute[73068]:   <model>Nehalem</model>
Aug 26 11:32:46 user nova-compute[73068]: </cpu>
Aug 26 11:32:46 user nova-compute[73068]:  {{(pid=73068) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 26 11:32:46 user nova-compute[73068]: INFO nova.virt.node [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Generated node identity e49cbbd6-e608-41cf-a55c-7dee214caafe
Aug 26 11:32:46 user nova-compute[73068]: INFO nova.virt.node [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Wrote node identity e49cbbd6-e608-41cf-a55c-7dee214caafe to /opt/stack/data/nova/compute_id
Aug 26 11:32:46 user nova-compute[73068]: WARNING nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Compute nodes ['e49cbbd6-e608-41cf-a55c-7dee214caafe'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 26 11:32:46 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 26 11:32:46 user nova-compute[73068]: WARNING nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 11:32:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:32:46 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:32:46 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:32:46 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Hypervisor/Node resource view: name=user free_ram=10902MB free_disk=26.34604263305664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:32:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:32:46 user nova-compute[73068]: WARNING nova.compute.resource_tracker [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] No compute node record for user:e49cbbd6-e608-41cf-a55c-7dee214caafe: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host e49cbbd6-e608-41cf-a55c-7dee214caafe could not be found.
Aug 26 11:32:46 user nova-compute[73068]: INFO nova.compute.resource_tracker [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Compute node record created for user:user with uuid: e49cbbd6-e608-41cf-a55c-7dee214caafe
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:32:47 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [req-520be545-79b2-4714-8a1d-b3379d07c7e7] Created resource provider record via placement API for resource provider with UUID e49cbbd6-e608-41cf-a55c-7dee214caafe and name user.
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73068) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 26 11:32:47 user nova-compute[73068]: INFO nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] kernel doesn't support AMD SEV
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Libvirt baseline CPU <cpu>
Aug 26 11:32:47 user nova-compute[73068]:   <arch>x86_64</arch>
Aug 26 11:32:47 user nova-compute[73068]:   <model>Nehalem</model>
Aug 26 11:32:47 user nova-compute[73068]:   <vendor>Intel</vendor>
Aug 26 11:32:47 user nova-compute[73068]:   <topology sockets="6" cores="1" threads="1"/>
Aug 26 11:32:47 user nova-compute[73068]: </cpu>
Aug 26 11:32:47 user nova-compute[73068]:  {{(pid=73068) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Updated inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Updating resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe generation from 0 to 1 during operation: update_inventory {{(pid=73068) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Updating resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe generation from 1 to 2 during operation: update_traits {{(pid=73068) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.service [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Creating RPC server for service compute {{(pid=73068) start /opt/stack/nova/nova/service.py:182}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.service [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Join ServiceGroup membership for this service compute {{(pid=73068) start /opt/stack/nova/nova/service.py:199}}
Aug 26 11:32:47 user nova-compute[73068]: DEBUG nova.servicegroup.drivers.db [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73068) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 26 11:32:51 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:32:51 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:33:38 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:33:38 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:33:38 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=10288MB free_disk=26.249752044677734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:33:38 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:33:39 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:33:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:34:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:34:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:34:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:34:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:34:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:34:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 11:34:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:34:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:34:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:34:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:34:40 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:34:40 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:34:40 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=10233MB free_disk=26.28122329711914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:34:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.101s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:35:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:35:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:35:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:35:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:35:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:35:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:35:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:35:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 11:35:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:35:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:35:41 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:35:41 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:35:41 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=10205MB free_disk=26.07992172241211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:35:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.097s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:35:42 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:36:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:36:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:36:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:36:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:36:42 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:36:42 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:36:42 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:36:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:36:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:36:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 11:36:42 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:36:42 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:36:43 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:36:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:43 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:36:43 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:36:43 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:36:43 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=9490MB free_disk=26.102130889892578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:36:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:43 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:36:43 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:36:44 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:36:44 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:36:44 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:36:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "937978de-8e83-42e7-b906-ccc226924f1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:36:51 user nova-compute[73068]: INFO nova.compute.claims [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Claim successful on node user
Aug 26 11:36:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "fba812b3-7791-463f-9c86-a51ae7a7457d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:36:51 user nova-compute[73068]: INFO nova.compute.claims [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Claim successful on node user
Aug 26 11:36:51 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:36:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:36:51 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:36:51 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:36:52 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Creating image(s)
Aug 26 11:36:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "/opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "/opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "/opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:36:52 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:36:52 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Creating image(s)
Aug 26 11:36:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "/opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "/opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "/opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.policy [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '613022b47a2e40ca949864fa83fa2e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f7f84d7714f8d94971cae316c2215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:36:52 user nova-compute[73068]: DEBUG nova.policy [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '442fddac9e534bbc9d8a5966e6bc3c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bdd7cec1d84290be2b2a22a7834b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:36:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98.part --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98.part --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:53 user nova-compute[73068]: DEBUG nova.virt.images [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] 7a04c5f4-de55-416c-8955-be802fd6bf8e was qcow2, converting to raw {{(pid=73068) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 11:36:53 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:36:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98.part /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98.converted {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98.part /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98.converted" returned: 0 in 0.263s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98.converted --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.698s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:53 user nova-compute[73068]: INFO oslo.privsep.daemon [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2rqk8cre/privsep.sock']
Aug 26 11:36:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 1.277s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:53 user sudo[82342]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2rqk8cre/privsep.sock
Aug 26 11:36:53 user sudo[82342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 11:36:55 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Successfully created port: d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:36:55 user sudo[82342]: pam_unix(sudo:session): session closed for user root
Aug 26 11:36:55 user nova-compute[73068]: INFO oslo.privsep.daemon [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Spawned new privsep daemon via rootwrap
Aug 26 11:36:55 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 11:36:55 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 11:36:55 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 11:36:55 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82349
Aug 26 11:36:55 user nova-compute[73068]: WARNING oslo_privsep.priv_context [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] privsep daemon already running
Aug 26 11:36:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:55 user nova-compute[73068]: DEBUG nova.network.neutron [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Successfully created port: ee146c0d-fc52-4402-9c39-b4957128f3ef {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.208s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.221s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk 1073741824" returned: 0 in 0.053s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.227s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.210s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.268s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:36:56 user nova-compute[73068]: INFO nova.compute.claims [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Claim successful on node user
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk 1073741824" returned: 0 in 0.061s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Cannot resize image /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Ensure instance console log exists: /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.152s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Cannot resize image /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Ensure instance console log exists: /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:56 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG nova.network.neutron [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:36:57 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:36:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:36:57 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Creating image(s)
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "/opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "/opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG nova.policy [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4b86976b16444b18f8af379585b27f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbaaf8bfcebc433d899f65eb01b79426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.248s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.232s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk 1073741824" returned: 0 in 0.054s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.161s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:58 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:36:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:36:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:36:58 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Cannot resize image /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:36:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:36:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Ensure instance console log exists: /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:36:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:36:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:36:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Successfully updated port: d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Successfully created port: 633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquired lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Successfully updated port: ee146c0d-fc52-4402-9c39-b4957128f3ef {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquired lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-6a0a4c0a-1789-44c6-b903-c44cac27c4de req-7daf7fbd-708b-4341-9b5c-767c673b4819 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Received event network-changed-d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-6a0a4c0a-1789-44c6-b903-c44cac27c4de req-7daf7fbd-708b-4341-9b5c-767c673b4819 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Refreshing instance network info cache due to event network-changed-d5258489-ce6e-41e3-b067-cb26bb791c03. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6a0a4c0a-1789-44c6-b903-c44cac27c4de req-7daf7fbd-708b-4341-9b5c-767c673b4819 service nova] Acquiring lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-fa367751-3b87-4de8-95c8-bd6bb15a6767 req-de009c64-a3c4-4f47-be18-b60d1e8c4a8c service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Received event network-changed-ee146c0d-fc52-4402-9c39-b4957128f3ef {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-fa367751-3b87-4de8-95c8-bd6bb15a6767 req-de009c64-a3c4-4f47-be18-b60d1e8c4a8c service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Refreshing instance network info cache due to event network-changed-ee146c0d-fc52-4402-9c39-b4957128f3ef. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:36:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fa367751-3b87-4de8-95c8-bd6bb15a6767 req-de009c64-a3c4-4f47-be18-b60d1e8c4a8c service nova] Acquiring lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Updating instance_info_cache with network_info: [{"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Releasing lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Instance network_info: |[{"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6a0a4c0a-1789-44c6-b903-c44cac27c4de req-7daf7fbd-708b-4341-9b5c-767c673b4819 service nova] Acquired lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.network.neutron [req-6a0a4c0a-1789-44c6-b903-c44cac27c4de req-7daf7fbd-708b-4341-9b5c-767c673b4819 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Refreshing network info cache for port d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Start _get_guest_xml network_info=[{"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:37:00 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:00 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1619037140',display_name='tempest-ServersNegativeTestJSON-server-1619037140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1619037140',id=2,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17bdd7cec1d84290be2b2a22a7834b40',ramdisk_id='',reservation_id='r-e6xiv6cd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-41614951',owner_user_name='tempest-ServersNegativeTestJSON-41614951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:36:52Z,user_data=None,user_id='442fddac9e534bbc9d8a5966e6bc3c26',uuid=fba812b3-7791-463f-9c86-a51ae7a7457d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converting VIF {"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:4d,bridge_name='br-int',has_traffic_filtering=True,id=d5258489-ce6e-41e3-b067-cb26bb791c03,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5258489-ce') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.objects.instance [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lazy-loading 'pci_devices' on Instance uuid fba812b3-7791-463f-9c86-a51ae7a7457d {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:37:00 user nova-compute[73068]:   <uuid>fba812b3-7791-463f-9c86-a51ae7a7457d</uuid>
Aug 26 11:37:00 user nova-compute[73068]:   <name>instance-00000002</name>
Aug 26 11:37:00 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:37:00 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:37:00 user nova-compute[73068]:   <metadata>
Aug 26 11:37:00 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:37:00 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:37:00 user nova-compute[73068]:       <nova:name>tempest-ServersNegativeTestJSON-server-1619037140</nova:name>
Aug 26 11:37:00 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:37:00</nova:creationTime>
Aug 26 11:37:00 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:37:00 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:37:00 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:37:00 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:37:00 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:37:00 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:37:00 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:37:00 user nova-compute[73068]:       <nova:owner>
Aug 26 11:37:00 user nova-compute[73068]:         <nova:user uuid="442fddac9e534bbc9d8a5966e6bc3c26">tempest-ServersNegativeTestJSON-41614951-project-member</nova:user>
Aug 26 11:37:00 user nova-compute[73068]:         <nova:project uuid="17bdd7cec1d84290be2b2a22a7834b40">tempest-ServersNegativeTestJSON-41614951</nova:project>
Aug 26 11:37:00 user nova-compute[73068]:       </nova:owner>
Aug 26 11:37:00 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:37:00 user nova-compute[73068]:       <nova:ports>
Aug 26 11:37:00 user nova-compute[73068]:         <nova:port uuid="d5258489-ce6e-41e3-b067-cb26bb791c03">
Aug 26 11:37:00 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 11:37:00 user nova-compute[73068]:         </nova:port>
Aug 26 11:37:00 user nova-compute[73068]:       </nova:ports>
Aug 26 11:37:00 user nova-compute[73068]:     </nova:instance>
Aug 26 11:37:00 user nova-compute[73068]:   </metadata>
Aug 26 11:37:00 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:37:00 user nova-compute[73068]:     <system>
Aug 26 11:37:00 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:37:00 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:37:00 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:37:00 user nova-compute[73068]:       <entry name="serial">fba812b3-7791-463f-9c86-a51ae7a7457d</entry>
Aug 26 11:37:00 user nova-compute[73068]:       <entry name="uuid">fba812b3-7791-463f-9c86-a51ae7a7457d</entry>
Aug 26 11:37:00 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:37:00 user nova-compute[73068]:     </system>
Aug 26 11:37:00 user nova-compute[73068]:   </sysinfo>
Aug 26 11:37:00 user nova-compute[73068]:   <os>
Aug 26 11:37:00 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:37:00 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:37:00 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:37:00 user nova-compute[73068]:   </os>
Aug 26 11:37:00 user nova-compute[73068]:   <features>
Aug 26 11:37:00 user nova-compute[73068]:     <acpi/>
Aug 26 11:37:00 user nova-compute[73068]:     <apic/>
Aug 26 11:37:00 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:37:00 user nova-compute[73068]:   </features>
Aug 26 11:37:00 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:37:00 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:37:00 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:37:00 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:37:00 user nova-compute[73068]:   </clock>
Aug 26 11:37:00 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:37:00 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:37:00 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:37:00 user nova-compute[73068]:   </cpu>
Aug 26 11:37:00 user nova-compute[73068]:   <devices>
Aug 26 11:37:00 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:37:00 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:37:00 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk"/>
Aug 26 11:37:00 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:37:00 user nova-compute[73068]:     </disk>
Aug 26 11:37:00 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:37:00 user nova-compute[73068]:       <mac address="fa:16:3e:49:3b:4d"/>
Aug 26 11:37:00 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:00 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:37:00 user nova-compute[73068]:       <target dev="tapd5258489-ce"/>
Aug 26 11:37:00 user nova-compute[73068]:     </interface>
Aug 26 11:37:00 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:37:00 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/console.log" append="off"/>
Aug 26 11:37:00 user nova-compute[73068]:     </serial>
Aug 26 11:37:00 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:37:00 user nova-compute[73068]:     <video>
Aug 26 11:37:00 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:00 user nova-compute[73068]:     </video>
Aug 26 11:37:00 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:37:00 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:37:00 user nova-compute[73068]:     </rng>
Aug 26 11:37:00 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:37:00 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:37:00 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:37:00 user nova-compute[73068]:     </memballoon>
Aug 26 11:37:00 user nova-compute[73068]:   </devices>
Aug 26 11:37:00 user nova-compute[73068]: </domain>
Aug 26 11:37:00 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1619037140',display_name='tempest-ServersNegativeTestJSON-server-1619037140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1619037140',id=2,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17bdd7cec1d84290be2b2a22a7834b40',ramdisk_id='',reservation_id='r-e6xiv6cd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-41614951',owner_user_name='tempest-ServersNegativeTestJSON-41614951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:36:52Z,user_data=None,user_id='442fddac9e534bbc9d8a5966e6bc3c26',uuid=fba812b3-7791-463f-9c86-a51ae7a7457d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converting VIF {"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:4d,bridge_name='br-int',has_traffic_filtering=True,id=d5258489-ce6e-41e3-b067-cb26bb791c03,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5258489-ce') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG os_vif [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:4d,bridge_name='br-int',has_traffic_filtering=True,id=d5258489-ce6e-41e3-b067-cb26bb791c03,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5258489-ce') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Created schema index Interface.name {{(pid=73068) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Created schema index Port.name {{(pid=73068) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Created schema index Bridge.name {{(pid=73068) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [POLLOUT] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:37:00 user nova-compute[73068]: INFO oslo.privsep.daemon [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp4efmd7db/privsep.sock']
Aug 26 11:37:00 user sudo[82435]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp4efmd7db/privsep.sock
Aug 26 11:37:00 user sudo[82435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.network.neutron [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Updating instance_info_cache with network_info: [{"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Releasing lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Instance network_info: |[{"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fa367751-3b87-4de8-95c8-bd6bb15a6767 req-de009c64-a3c4-4f47-be18-b60d1e8c4a8c service nova] Acquired lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.network.neutron [req-fa367751-3b87-4de8-95c8-bd6bb15a6767 req-de009c64-a3c4-4f47-be18-b60d1e8c4a8c service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Refreshing network info cache for port ee146c0d-fc52-4402-9c39-b4957128f3ef {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Start _get_guest_xml network_info=[{"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:37:01 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:01 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1073269416',display_name='tempest-AttachVolumeNegativeTest-server-1073269416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1073269416',id=1,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOLNmZFejabsRCsSjaAfTQYfq2UrsHUOJ8+kjHnqWqVDD6InojY6380HREoVS/sgY1vzdwgCinhaEFDHYgMyHat0kngtKalKbyPwsE51i2O0dnIjEF7IsgNiB/Zybg2ZQ==',key_name='tempest-keypair-148214339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-in5uj5gm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:36:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=937978de-8e83-42e7-b906-ccc226924f1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=ee146c0d-fc52-4402-9c39-b4957128f3ef,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee146c0d-fc') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'pci_devices' on Instance uuid 937978de-8e83-42e7-b906-ccc226924f1f {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:37:01 user nova-compute[73068]:   <uuid>937978de-8e83-42e7-b906-ccc226924f1f</uuid>
Aug 26 11:37:01 user nova-compute[73068]:   <name>instance-00000001</name>
Aug 26 11:37:01 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:37:01 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:37:01 user nova-compute[73068]:   <metadata>
Aug 26 11:37:01 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:37:01 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:37:01 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1073269416</nova:name>
Aug 26 11:37:01 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:37:01</nova:creationTime>
Aug 26 11:37:01 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:37:01 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:37:01 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:37:01 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:37:01 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:37:01 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:37:01 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:37:01 user nova-compute[73068]:       <nova:owner>
Aug 26 11:37:01 user nova-compute[73068]:         <nova:user uuid="613022b47a2e40ca949864fa83fa2e73">tempest-AttachVolumeNegativeTest-1321002765-project-member</nova:user>
Aug 26 11:37:01 user nova-compute[73068]:         <nova:project uuid="770f7f84d7714f8d94971cae316c2215">tempest-AttachVolumeNegativeTest-1321002765</nova:project>
Aug 26 11:37:01 user nova-compute[73068]:       </nova:owner>
Aug 26 11:37:01 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:37:01 user nova-compute[73068]:       <nova:ports>
Aug 26 11:37:01 user nova-compute[73068]:         <nova:port uuid="ee146c0d-fc52-4402-9c39-b4957128f3ef">
Aug 26 11:37:01 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 11:37:01 user nova-compute[73068]:         </nova:port>
Aug 26 11:37:01 user nova-compute[73068]:       </nova:ports>
Aug 26 11:37:01 user nova-compute[73068]:     </nova:instance>
Aug 26 11:37:01 user nova-compute[73068]:   </metadata>
Aug 26 11:37:01 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:37:01 user nova-compute[73068]:     <system>
Aug 26 11:37:01 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:37:01 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:37:01 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:37:01 user nova-compute[73068]:       <entry name="serial">937978de-8e83-42e7-b906-ccc226924f1f</entry>
Aug 26 11:37:01 user nova-compute[73068]:       <entry name="uuid">937978de-8e83-42e7-b906-ccc226924f1f</entry>
Aug 26 11:37:01 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:37:01 user nova-compute[73068]:     </system>
Aug 26 11:37:01 user nova-compute[73068]:   </sysinfo>
Aug 26 11:37:01 user nova-compute[73068]:   <os>
Aug 26 11:37:01 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:37:01 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:37:01 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:37:01 user nova-compute[73068]:   </os>
Aug 26 11:37:01 user nova-compute[73068]:   <features>
Aug 26 11:37:01 user nova-compute[73068]:     <acpi/>
Aug 26 11:37:01 user nova-compute[73068]:     <apic/>
Aug 26 11:37:01 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:37:01 user nova-compute[73068]:   </features>
Aug 26 11:37:01 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:37:01 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:37:01 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:37:01 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:37:01 user nova-compute[73068]:   </clock>
Aug 26 11:37:01 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:37:01 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:37:01 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:37:01 user nova-compute[73068]:   </cpu>
Aug 26 11:37:01 user nova-compute[73068]:   <devices>
Aug 26 11:37:01 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:37:01 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:37:01 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk"/>
Aug 26 11:37:01 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:37:01 user nova-compute[73068]:     </disk>
Aug 26 11:37:01 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:37:01 user nova-compute[73068]:       <mac address="fa:16:3e:f4:ed:38"/>
Aug 26 11:37:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:01 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:37:01 user nova-compute[73068]:       <target dev="tapee146c0d-fc"/>
Aug 26 11:37:01 user nova-compute[73068]:     </interface>
Aug 26 11:37:01 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:37:01 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/console.log" append="off"/>
Aug 26 11:37:01 user nova-compute[73068]:     </serial>
Aug 26 11:37:01 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:37:01 user nova-compute[73068]:     <video>
Aug 26 11:37:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:01 user nova-compute[73068]:     </video>
Aug 26 11:37:01 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:37:01 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:37:01 user nova-compute[73068]:     </rng>
Aug 26 11:37:01 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:37:01 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:37:01 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:37:01 user nova-compute[73068]:     </memballoon>
Aug 26 11:37:01 user nova-compute[73068]:   </devices>
Aug 26 11:37:01 user nova-compute[73068]: </domain>
Aug 26 11:37:01 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1073269416',display_name='tempest-AttachVolumeNegativeTest-server-1073269416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1073269416',id=1,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOLNmZFejabsRCsSjaAfTQYfq2UrsHUOJ8+kjHnqWqVDD6InojY6380HREoVS/sgY1vzdwgCinhaEFDHYgMyHat0kngtKalKbyPwsE51i2O0dnIjEF7IsgNiB/Zybg2ZQ==',key_name='tempest-keypair-148214339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-in5uj5gm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:36:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=937978de-8e83-42e7-b906-ccc226924f1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=ee146c0d-fc52-4402-9c39-b4957128f3ef,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee146c0d-fc') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG os_vif [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=ee146c0d-fc52-4402-9c39-b4957128f3ef,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee146c0d-fc') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.network.neutron [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Successfully updated port: 633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquired lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.network.neutron [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.network.neutron [req-6a0a4c0a-1789-44c6-b903-c44cac27c4de req-7daf7fbd-708b-4341-9b5c-767c673b4819 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Updated VIF entry in instance network info cache for port d5258489-ce6e-41e3-b067-cb26bb791c03. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG nova.network.neutron [req-6a0a4c0a-1789-44c6-b903-c44cac27c4de req-7daf7fbd-708b-4341-9b5c-767c673b4819 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Updating instance_info_cache with network_info: [{"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6a0a4c0a-1789-44c6-b903-c44cac27c4de req-7daf7fbd-708b-4341-9b5c-767c673b4819 service nova] Releasing lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.network.neutron [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-d9140ad7-7ef9-4ded-a32a-f70fc93e8d97 req-4cbdbaca-aa44-46ae-bf3a-0c84fef4fdc3 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-changed-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-d9140ad7-7ef9-4ded-a32a-f70fc93e8d97 req-4cbdbaca-aa44-46ae-bf3a-0c84fef4fdc3 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Refreshing instance network info cache due to event network-changed-633ed4fe-2630-42c2-b0ff-dba262056dad. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d9140ad7-7ef9-4ded-a32a-f70fc93e8d97 req-4cbdbaca-aa44-46ae-bf3a-0c84fef4fdc3 service nova] Acquiring lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.network.neutron [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating instance_info_cache with network_info: [{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:02 user sudo[82435]: pam_unix(sudo:session): session closed for user root
Aug 26 11:37:02 user nova-compute[73068]: INFO oslo.privsep.daemon [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Spawned new privsep daemon via rootwrap
Aug 26 11:37:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:02 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 11:37:02 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 11:37:02 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 26 11:37:02 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82443
Aug 26 11:37:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Releasing lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Instance network_info: |[{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d9140ad7-7ef9-4ded-a32a-f70fc93e8d97 req-4cbdbaca-aa44-46ae-bf3a-0c84fef4fdc3 service nova] Acquired lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.network.neutron [req-d9140ad7-7ef9-4ded-a32a-f70fc93e8d97 req-4cbdbaca-aa44-46ae-bf3a-0c84fef4fdc3 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Refreshing network info cache for port 633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Start _get_guest_xml network_info=[{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:37:02 user nova-compute[73068]: WARNING oslo_privsep.priv_context [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] privsep daemon already running
Aug 26 11:37:02 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:02 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1968770570',display_name='tempest-ServerStableDeviceRescueTest-server-1968770570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1968770570',id=3,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANeDkCIfgF5NbRelSZtGfTmmKZCd893ZRa0qT/kWApiiF8kiY5NBEz60VroBFpV09CP67IhOPrec3jQOQpp9+8YbogTHVaRrAkokZk75Nc8REAUpIeu1QXyqQ4CF4sKWw==',key_name='tempest-keypair-2049648768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbaaf8bfcebc433d899f65eb01b79426',ramdisk_id='',reservation_id='r-10gfaets',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-5310612',owner_user_name='tempest-ServerStableDeviceRescueTest-5310612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b86976b16444b18f8af379585b27f7',uuid=2e64329a-4cf4-4f10-bbb9-4bb50754841a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Converting VIF {"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=633ed4fe-2630-42c2-b0ff-dba262056dad,network=Network(693a78d0-f114-4b5d-8504-687156dedb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633ed4fe-26') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.objects.instance [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:37:02 user nova-compute[73068]:   <uuid>2e64329a-4cf4-4f10-bbb9-4bb50754841a</uuid>
Aug 26 11:37:02 user nova-compute[73068]:   <name>instance-00000003</name>
Aug 26 11:37:02 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:37:02 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:37:02 user nova-compute[73068]:   <metadata>
Aug 26 11:37:02 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:37:02 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:37:02 user nova-compute[73068]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1968770570</nova:name>
Aug 26 11:37:02 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:37:02</nova:creationTime>
Aug 26 11:37:02 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:37:02 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:37:02 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:37:02 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:37:02 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:37:02 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:37:02 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:37:02 user nova-compute[73068]:       <nova:owner>
Aug 26 11:37:02 user nova-compute[73068]:         <nova:user uuid="e4b86976b16444b18f8af379585b27f7">tempest-ServerStableDeviceRescueTest-5310612-project-member</nova:user>
Aug 26 11:37:02 user nova-compute[73068]:         <nova:project uuid="dbaaf8bfcebc433d899f65eb01b79426">tempest-ServerStableDeviceRescueTest-5310612</nova:project>
Aug 26 11:37:02 user nova-compute[73068]:       </nova:owner>
Aug 26 11:37:02 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:37:02 user nova-compute[73068]:       <nova:ports>
Aug 26 11:37:02 user nova-compute[73068]:         <nova:port uuid="633ed4fe-2630-42c2-b0ff-dba262056dad">
Aug 26 11:37:02 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 11:37:02 user nova-compute[73068]:         </nova:port>
Aug 26 11:37:02 user nova-compute[73068]:       </nova:ports>
Aug 26 11:37:02 user nova-compute[73068]:     </nova:instance>
Aug 26 11:37:02 user nova-compute[73068]:   </metadata>
Aug 26 11:37:02 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:37:02 user nova-compute[73068]:     <system>
Aug 26 11:37:02 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:37:02 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:37:02 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:37:02 user nova-compute[73068]:       <entry name="serial">2e64329a-4cf4-4f10-bbb9-4bb50754841a</entry>
Aug 26 11:37:02 user nova-compute[73068]:       <entry name="uuid">2e64329a-4cf4-4f10-bbb9-4bb50754841a</entry>
Aug 26 11:37:02 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:37:02 user nova-compute[73068]:     </system>
Aug 26 11:37:02 user nova-compute[73068]:   </sysinfo>
Aug 26 11:37:02 user nova-compute[73068]:   <os>
Aug 26 11:37:02 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:37:02 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:37:02 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:37:02 user nova-compute[73068]:   </os>
Aug 26 11:37:02 user nova-compute[73068]:   <features>
Aug 26 11:37:02 user nova-compute[73068]:     <acpi/>
Aug 26 11:37:02 user nova-compute[73068]:     <apic/>
Aug 26 11:37:02 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:37:02 user nova-compute[73068]:   </features>
Aug 26 11:37:02 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:37:02 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:37:02 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:37:02 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:37:02 user nova-compute[73068]:   </clock>
Aug 26 11:37:02 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:37:02 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:37:02 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:37:02 user nova-compute[73068]:   </cpu>
Aug 26 11:37:02 user nova-compute[73068]:   <devices>
Aug 26 11:37:02 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:37:02 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:37:02 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk"/>
Aug 26 11:37:02 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:37:02 user nova-compute[73068]:     </disk>
Aug 26 11:37:02 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:37:02 user nova-compute[73068]:       <mac address="fa:16:3e:f6:f1:f0"/>
Aug 26 11:37:02 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:02 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:37:02 user nova-compute[73068]:       <target dev="tap633ed4fe-26"/>
Aug 26 11:37:02 user nova-compute[73068]:     </interface>
Aug 26 11:37:02 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:37:02 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/console.log" append="off"/>
Aug 26 11:37:02 user nova-compute[73068]:     </serial>
Aug 26 11:37:02 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:37:02 user nova-compute[73068]:     <video>
Aug 26 11:37:02 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:02 user nova-compute[73068]:     </video>
Aug 26 11:37:02 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:37:02 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:37:02 user nova-compute[73068]:     </rng>
Aug 26 11:37:02 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:37:02 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:37:02 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:37:02 user nova-compute[73068]:     </memballoon>
Aug 26 11:37:02 user nova-compute[73068]:   </devices>
Aug 26 11:37:02 user nova-compute[73068]: </domain>
Aug 26 11:37:02 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1968770570',display_name='tempest-ServerStableDeviceRescueTest-server-1968770570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1968770570',id=3,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANeDkCIfgF5NbRelSZtGfTmmKZCd893ZRa0qT/kWApiiF8kiY5NBEz60VroBFpV09CP67IhOPrec3jQOQpp9+8YbogTHVaRrAkokZk75Nc8REAUpIeu1QXyqQ4CF4sKWw==',key_name='tempest-keypair-2049648768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbaaf8bfcebc433d899f65eb01b79426',ramdisk_id='',reservation_id='r-10gfaets',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-5310612',owner_user_name='tempest-ServerStableDeviceRescueTest-5310612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b86976b16444b18f8af379585b27f7',uuid=2e64329a-4cf4-4f10-bbb9-4bb50754841a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Converting VIF {"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=633ed4fe-2630-42c2-b0ff-dba262056dad,network=Network(693a78d0-f114-4b5d-8504-687156dedb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633ed4fe-26') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG os_vif [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=633ed4fe-2630-42c2-b0ff-dba262056dad,network=Network(693a78d0-f114-4b5d-8504-687156dedb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633ed4fe-26') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee146c0d-fc, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee146c0d-fc, col_values=(('external_ids', {'iface-id': 'ee146c0d-fc52-4402-9c39-b4957128f3ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:ed:38', 'vm-uuid': '937978de-8e83-42e7-b906-ccc226924f1f'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap633ed4fe-26, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap633ed4fe-26, col_values=(('external_ids', {'iface-id': '633ed4fe-2630-42c2-b0ff-dba262056dad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:f1:f0', 'vm-uuid': '2e64329a-4cf4-4f10-bbb9-4bb50754841a'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:03 user nova-compute[73068]: INFO os_vif [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=ee146c0d-fc52-4402-9c39-b4957128f3ef,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee146c0d-fc')
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:03 user nova-compute[73068]: INFO os_vif [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=633ed4fe-2630-42c2-b0ff-dba262056dad,network=Network(693a78d0-f114-4b5d-8504-687156dedb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633ed4fe-26')
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5258489-ce, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5258489-ce, col_values=(('external_ids', {'iface-id': 'd5258489-ce6e-41e3-b067-cb26bb791c03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:3b:4d', 'vm-uuid': 'fba812b3-7791-463f-9c86-a51ae7a7457d'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:03 user nova-compute[73068]: INFO os_vif [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:3b:4d,bridge_name='br-int',has_traffic_filtering=True,id=d5258489-ce6e-41e3-b067-cb26bb791c03,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5258489-ce')
Aug 26 11:37:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No VIF found with MAC fa:16:3e:f4:ed:38, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] No VIF found with MAC fa:16:3e:f6:f1:f0, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:37:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] No VIF found with MAC fa:16:3e:49:3b:4d, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:37:04 user nova-compute[73068]: DEBUG nova.network.neutron [req-fa367751-3b87-4de8-95c8-bd6bb15a6767 req-de009c64-a3c4-4f47-be18-b60d1e8c4a8c service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Updated VIF entry in instance network info cache for port ee146c0d-fc52-4402-9c39-b4957128f3ef. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:37:04 user nova-compute[73068]: DEBUG nova.network.neutron [req-fa367751-3b87-4de8-95c8-bd6bb15a6767 req-de009c64-a3c4-4f47-be18-b60d1e8c4a8c service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Updating instance_info_cache with network_info: [{"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fa367751-3b87-4de8-95c8-bd6bb15a6767 req-de009c64-a3c4-4f47-be18-b60d1e8c4a8c service nova] Releasing lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:04 user nova-compute[73068]: DEBUG nova.network.neutron [req-d9140ad7-7ef9-4ded-a32a-f70fc93e8d97 req-4cbdbaca-aa44-46ae-bf3a-0c84fef4fdc3 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updated VIF entry in instance network info cache for port 633ed4fe-2630-42c2-b0ff-dba262056dad. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:37:04 user nova-compute[73068]: DEBUG nova.network.neutron [req-d9140ad7-7ef9-4ded-a32a-f70fc93e8d97 req-4cbdbaca-aa44-46ae-bf3a-0c84fef4fdc3 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating instance_info_cache with network_info: [{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d9140ad7-7ef9-4ded-a32a-f70fc93e8d97 req-4cbdbaca-aa44-46ae-bf3a-0c84fef4fdc3 service nova] Releasing lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:09 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049829.9428954, 937978de-8e83-42e7-b906-ccc226924f1f => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:09 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] VM Resumed (Lifecycle Event)
Aug 26 11:37:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:37:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:37:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:37:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:37:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Instance spawned successfully.
Aug 26 11:37:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Instance spawned successfully.
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Instance spawned successfully.
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Took 18.19 seconds to spawn the instance on the hypervisor.
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049829.9461706, 937978de-8e83-42e7-b906-ccc226924f1f => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] VM Started (Lifecycle Event)
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Took 13.18 seconds to spawn the instance on the hypervisor.
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049829.9679406, 2e64329a-4cf4-4f10-bbb9-4bb50754841a => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] VM Resumed (Lifecycle Event)
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Took 19.19 seconds to build instance.
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Took 18.14 seconds to spawn the instance on the hypervisor.
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049829.968049, 2e64329a-4cf4-4f10-bbb9-4bb50754841a => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] VM Started (Lifecycle Event)
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Took 14.25 seconds to build instance.
Aug 26 11:37:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d1b511a6-b2b4-4c37-b189-9fba154b3b55 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.571s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aeefdec8-f55d-45bb-afe2-6227db4ab6f4 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.497s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Took 19.06 seconds to build instance.
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049830.2416422, fba812b3-7791-463f-9c86-a51ae7a7457d => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:10 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] VM Resumed (Lifecycle Event)
Aug 26 11:37:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5d22fb19-6406-4e2c-81bf-1f4d219118f5 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.190s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:11 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049830.2424867, fba812b3-7791-463f-9c86-a51ae7a7457d => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:11 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] VM Started (Lifecycle Event)
Aug 26 11:37:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:37:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:37:13 user nova-compute[73068]: INFO nova.compute.claims [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Claim successful on node user
Aug 26 11:37:14 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:37:14 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:37:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:37:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:37:14 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:37:14 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 26 11:37:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:37:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG nova.policy [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82abb02eedf84095a66a8ef23dd5d0e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a0444942992475b91cb620febed557a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:37:15 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Creating image(s)
Aug 26 11:37:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "/opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "/opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "/opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "b0050605d59af2b9df049973b6f02967bcc2e411" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "b0050605d59af2b9df049973b6f02967bcc2e411" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411.part --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411.part --force-share --output=json" returned: 0 in 0.330s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG nova.virt.images [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] 51dab0fa-ab90-4432-ab1d-6fdb8917085c was qcow2, converting to raw {{(pid=73068) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:37:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411.part /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411.converted {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411.part /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411.converted" returned: 0 in 0.224s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411.converted --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411.converted --force-share --output=json" returned: 0 in 0.319s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "b0050605d59af2b9df049973b6f02967bcc2e411" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.414s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Successfully created port: b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411 --force-share --output=json" returned: 0 in 0.286s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "b0050605d59af2b9df049973b6f02967bcc2e411" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "b0050605d59af2b9df049973b6f02967bcc2e411" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411 --force-share --output=json" returned: 0 in 0.330s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411,backing_fmt=raw /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411,backing_fmt=raw /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk 1073741824" returned: 0 in 0.087s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "b0050605d59af2b9df049973b6f02967bcc2e411" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.422s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:37:17 user nova-compute[73068]: INFO nova.compute.claims [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Claim successful on node user
Aug 26 11:37:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411 --force-share --output=json" returned: 0 in 0.275s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Cannot resize image /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Ensure instance console log exists: /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:17 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.766s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.network.neutron [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:37:18 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:37:18 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Creating image(s)
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "/opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "/opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "/opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Successfully updated port: b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "refresh_cache-85b6aa5b-72c1-415f-8552-19d0cd3859d6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquired lock "refresh_cache-85b6aa5b-72c1-415f-8552-19d0cd3859d6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-4a419fec-7ee6-4bd4-8115-49436db6cb9f req-9cad4500-c527-401c-bbe7-25a5d0c64391 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Received event network-changed-b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-4a419fec-7ee6-4bd4-8115-49436db6cb9f req-9cad4500-c527-401c-bbe7-25a5d0c64391 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Refreshing instance network info cache due to event network-changed-b2bf177e-b82e-48bd-9f92-9084b2339918. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4a419fec-7ee6-4bd4-8115-49436db6cb9f req-9cad4500-c527-401c-bbe7-25a5d0c64391 service nova] Acquiring lock "refresh_cache-85b6aa5b-72c1-415f-8552-19d0cd3859d6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.302s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:18 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.224s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk 1073741824" returned: 0 in 0.073s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.policy [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed086ebc2de14a0f9b55c87a40f5f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1112219a9fc34797b1d9f5e872bea350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.258s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Updating instance_info_cache with network_info: [{"id": "b2bf177e-b82e-48bd-9f92-9084b2339918", "address": "fa:16:3e:2d:f2:7b", "network": {"id": "2bb55e61-9a1b-424a-950c-ef73a9e48345", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772847370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0444942992475b91cb620febed557a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bf177e-b8", "ovs_interfaceid": "b2bf177e-b82e-48bd-9f92-9084b2339918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Cannot resize image /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Ensure instance console log exists: /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Releasing lock "refresh_cache-85b6aa5b-72c1-415f-8552-19d0cd3859d6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Instance network_info: |[{"id": "b2bf177e-b82e-48bd-9f92-9084b2339918", "address": "fa:16:3e:2d:f2:7b", "network": {"id": "2bb55e61-9a1b-424a-950c-ef73a9e48345", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772847370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0444942992475b91cb620febed557a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bf177e-b8", "ovs_interfaceid": "b2bf177e-b82e-48bd-9f92-9084b2339918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4a419fec-7ee6-4bd4-8115-49436db6cb9f req-9cad4500-c527-401c-bbe7-25a5d0c64391 service nova] Acquired lock "refresh_cache-85b6aa5b-72c1-415f-8552-19d0cd3859d6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.network.neutron [req-4a419fec-7ee6-4bd4-8115-49436db6cb9f req-9cad4500-c527-401c-bbe7-25a5d0c64391 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Refreshing network info cache for port b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Start _get_guest_xml network_info=[{"id": "b2bf177e-b82e-48bd-9f92-9084b2339918", "address": "fa:16:3e:2d:f2:7b", "network": {"id": "2bb55e61-9a1b-424a-950c-ef73a9e48345", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772847370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0444942992475b91cb620febed557a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bf177e-b8", "ovs_interfaceid": "b2bf177e-b82e-48bd-9f92-9084b2339918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:37:04Z,direct_url=<?>,disk_format='qcow2',id=51dab0fa-ab90-4432-ab1d-6fdb8917085c,min_disk=0,min_ram=0,name='',owner='f5e014fb4001460b9479a1fde8d55a9b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:37:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/sda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '51dab0fa-ab90-4432-ab1d-6fdb8917085c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:37:19 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:19 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:37:04Z,direct_url=<?>,disk_format='qcow2',id=51dab0fa-ab90-4432-ab1d-6fdb8917085c,min_disk=0,min_ram=0,name='',owner='f5e014fb4001460b9479a1fde8d55a9b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:37:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1558244493',display_name='tempest-AttachSCSIVolumeTestJSON-server-1558244493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1558244493',id=4,image_ref='51dab0fa-ab90-4432-ab1d-6fdb8917085c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyUw+qufbQqUWoz/CiBmupIl2yOijhsEE9Tdzo8niAVnb+dwXzplAP2SA4EbWgspXBQc6Xp1sjBnmC0VPbaE/c1rxFovb+K6adl63cDyCTF1uK/l0j6soBsDxEkcJnf9w==',key_name='tempest-keypair-499677598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a0444942992475b91cb620febed557a',ramdisk_id='',reservation_id='r-k1sycq81',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51dab0fa-ab90-4432-ab1d-6fdb8917085c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-779650499',owner_user_name='tempest-AttachSCSIVolumeTestJSON-779650499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82abb02eedf84095a66a8ef23dd5d0e6',uuid=85b6aa5b-72c1-415f-8552-19d0cd3859d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2bf177e-b82e-48bd-9f92-9084b2339918", "address": "fa:16:3e:2d:f2:7b", "network": {"id": "2bb55e61-9a1b-424a-950c-ef73a9e48345", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772847370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0444942992475b91cb620febed557a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bf177e-b8", "ovs_interfaceid": "b2bf177e-b82e-48bd-9f92-9084b2339918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Converting VIF {"id": "b2bf177e-b82e-48bd-9f92-9084b2339918", "address": "fa:16:3e:2d:f2:7b", "network": {"id": "2bb55e61-9a1b-424a-950c-ef73a9e48345", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772847370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0444942992475b91cb620febed557a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bf177e-b8", "ovs_interfaceid": "b2bf177e-b82e-48bd-9f92-9084b2339918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:7b,bridge_name='br-int',has_traffic_filtering=True,id=b2bf177e-b82e-48bd-9f92-9084b2339918,network=Network(2bb55e61-9a1b-424a-950c-ef73a9e48345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bf177e-b8') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.objects.instance [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lazy-loading 'pci_devices' on Instance uuid 85b6aa5b-72c1-415f-8552-19d0cd3859d6 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:37:19 user nova-compute[73068]:   <uuid>85b6aa5b-72c1-415f-8552-19d0cd3859d6</uuid>
Aug 26 11:37:19 user nova-compute[73068]:   <name>instance-00000004</name>
Aug 26 11:37:19 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:37:19 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:37:19 user nova-compute[73068]:   <metadata>
Aug 26 11:37:19 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:37:19 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:37:19 user nova-compute[73068]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1558244493</nova:name>
Aug 26 11:37:19 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:37:19</nova:creationTime>
Aug 26 11:37:19 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:37:19 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:37:19 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:37:19 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:37:19 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:37:19 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:37:19 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:37:19 user nova-compute[73068]:       <nova:owner>
Aug 26 11:37:19 user nova-compute[73068]:         <nova:user uuid="82abb02eedf84095a66a8ef23dd5d0e6">tempest-AttachSCSIVolumeTestJSON-779650499-project-member</nova:user>
Aug 26 11:37:19 user nova-compute[73068]:         <nova:project uuid="9a0444942992475b91cb620febed557a">tempest-AttachSCSIVolumeTestJSON-779650499</nova:project>
Aug 26 11:37:19 user nova-compute[73068]:       </nova:owner>
Aug 26 11:37:19 user nova-compute[73068]:       <nova:root type="image" uuid="51dab0fa-ab90-4432-ab1d-6fdb8917085c"/>
Aug 26 11:37:19 user nova-compute[73068]:       <nova:ports>
Aug 26 11:37:19 user nova-compute[73068]:         <nova:port uuid="b2bf177e-b82e-48bd-9f92-9084b2339918">
Aug 26 11:37:19 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 11:37:19 user nova-compute[73068]:         </nova:port>
Aug 26 11:37:19 user nova-compute[73068]:       </nova:ports>
Aug 26 11:37:19 user nova-compute[73068]:     </nova:instance>
Aug 26 11:37:19 user nova-compute[73068]:   </metadata>
Aug 26 11:37:19 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:37:19 user nova-compute[73068]:     <system>
Aug 26 11:37:19 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:37:19 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:37:19 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:37:19 user nova-compute[73068]:       <entry name="serial">85b6aa5b-72c1-415f-8552-19d0cd3859d6</entry>
Aug 26 11:37:19 user nova-compute[73068]:       <entry name="uuid">85b6aa5b-72c1-415f-8552-19d0cd3859d6</entry>
Aug 26 11:37:19 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:37:19 user nova-compute[73068]:     </system>
Aug 26 11:37:19 user nova-compute[73068]:   </sysinfo>
Aug 26 11:37:19 user nova-compute[73068]:   <os>
Aug 26 11:37:19 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:37:19 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:37:19 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:37:19 user nova-compute[73068]:   </os>
Aug 26 11:37:19 user nova-compute[73068]:   <features>
Aug 26 11:37:19 user nova-compute[73068]:     <acpi/>
Aug 26 11:37:19 user nova-compute[73068]:     <apic/>
Aug 26 11:37:19 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:37:19 user nova-compute[73068]:   </features>
Aug 26 11:37:19 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:37:19 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:37:19 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:37:19 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:37:19 user nova-compute[73068]:   </clock>
Aug 26 11:37:19 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:37:19 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:37:19 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:37:19 user nova-compute[73068]:   </cpu>
Aug 26 11:37:19 user nova-compute[73068]:   <devices>
Aug 26 11:37:19 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:37:19 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:37:19 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk"/>
Aug 26 11:37:19 user nova-compute[73068]:       <target dev="sda" bus="scsi"/>
Aug 26 11:37:19 user nova-compute[73068]:       <address type="drive" controller="0" unit="0"/>
Aug 26 11:37:19 user nova-compute[73068]:     </disk>
Aug 26 11:37:19 user nova-compute[73068]:     <disk type="file" device="cdrom">
Aug 26 11:37:19 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 11:37:19 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk.config"/>
Aug 26 11:37:19 user nova-compute[73068]:       <target dev="sdb" bus="scsi"/>
Aug 26 11:37:19 user nova-compute[73068]:       <address type="drive" controller="0" unit="1"/>
Aug 26 11:37:19 user nova-compute[73068]:     </disk>
Aug 26 11:37:19 user nova-compute[73068]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 26 11:37:19 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:37:19 user nova-compute[73068]:       <mac address="fa:16:3e:2d:f2:7b"/>
Aug 26 11:37:19 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:19 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:37:19 user nova-compute[73068]:       <target dev="tapb2bf177e-b8"/>
Aug 26 11:37:19 user nova-compute[73068]:     </interface>
Aug 26 11:37:19 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:37:19 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/console.log" append="off"/>
Aug 26 11:37:19 user nova-compute[73068]:     </serial>
Aug 26 11:37:19 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:37:19 user nova-compute[73068]:     <video>
Aug 26 11:37:19 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:19 user nova-compute[73068]:     </video>
Aug 26 11:37:19 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:37:19 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:37:19 user nova-compute[73068]:     </rng>
Aug 26 11:37:19 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:37:19 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:37:19 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:37:19 user nova-compute[73068]:     </memballoon>
Aug 26 11:37:19 user nova-compute[73068]:   </devices>
Aug 26 11:37:19 user nova-compute[73068]: </domain>
Aug 26 11:37:19 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1558244493',display_name='tempest-AttachSCSIVolumeTestJSON-server-1558244493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1558244493',id=4,image_ref='51dab0fa-ab90-4432-ab1d-6fdb8917085c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyUw+qufbQqUWoz/CiBmupIl2yOijhsEE9Tdzo8niAVnb+dwXzplAP2SA4EbWgspXBQc6Xp1sjBnmC0VPbaE/c1rxFovb+K6adl63cDyCTF1uK/l0j6soBsDxEkcJnf9w==',key_name='tempest-keypair-499677598',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a0444942992475b91cb620febed557a',ramdisk_id='',reservation_id='r-k1sycq81',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51dab0fa-ab90-4432-ab1d-6fdb8917085c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-779650499',owner_user_name='tempest-AttachSCSIVolumeTestJSON-779650499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82abb02eedf84095a66a8ef23dd5d0e6',uuid=85b6aa5b-72c1-415f-8552-19d0cd3859d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2bf177e-b82e-48bd-9f92-9084b2339918", "address": "fa:16:3e:2d:f2:7b", "network": {"id": "2bb55e61-9a1b-424a-950c-ef73a9e48345", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772847370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0444942992475b91cb620febed557a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bf177e-b8", "ovs_interfaceid": "b2bf177e-b82e-48bd-9f92-9084b2339918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Converting VIF {"id": "b2bf177e-b82e-48bd-9f92-9084b2339918", "address": "fa:16:3e:2d:f2:7b", "network": {"id": "2bb55e61-9a1b-424a-950c-ef73a9e48345", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772847370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0444942992475b91cb620febed557a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bf177e-b8", "ovs_interfaceid": "b2bf177e-b82e-48bd-9f92-9084b2339918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:7b,bridge_name='br-int',has_traffic_filtering=True,id=b2bf177e-b82e-48bd-9f92-9084b2339918,network=Network(2bb55e61-9a1b-424a-950c-ef73a9e48345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bf177e-b8') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG os_vif [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:7b,bridge_name='br-int',has_traffic_filtering=True,id=b2bf177e-b82e-48bd-9f92-9084b2339918,network=Network(2bb55e61-9a1b-424a-950c-ef73a9e48345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bf177e-b8') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2bf177e-b8, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2bf177e-b8, col_values=(('external_ids', {'iface-id': 'b2bf177e-b82e-48bd-9f92-9084b2339918', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:f2:7b', 'vm-uuid': '85b6aa5b-72c1-415f-8552-19d0cd3859d6'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:19 user nova-compute[73068]: INFO os_vif [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:f2:7b,bridge_name='br-int',has_traffic_filtering=True,id=b2bf177e-b82e-48bd-9f92-9084b2339918,network=Network(2bb55e61-9a1b-424a-950c-ef73a9e48345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bf177e-b8')
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] No BDM found with device name sda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:37:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] No VIF found with MAC fa:16:3e:2d:f2:7b, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:37:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Using config drive
Aug 26 11:37:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:20 user nova-compute[73068]: DEBUG nova.network.neutron [req-4a419fec-7ee6-4bd4-8115-49436db6cb9f req-9cad4500-c527-401c-bbe7-25a5d0c64391 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Updated VIF entry in instance network info cache for port b2bf177e-b82e-48bd-9f92-9084b2339918. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:37:20 user nova-compute[73068]: DEBUG nova.network.neutron [req-4a419fec-7ee6-4bd4-8115-49436db6cb9f req-9cad4500-c527-401c-bbe7-25a5d0c64391 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Updating instance_info_cache with network_info: [{"id": "b2bf177e-b82e-48bd-9f92-9084b2339918", "address": "fa:16:3e:2d:f2:7b", "network": {"id": "2bb55e61-9a1b-424a-950c-ef73a9e48345", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772847370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0444942992475b91cb620febed557a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bf177e-b8", "ovs_interfaceid": "b2bf177e-b82e-48bd-9f92-9084b2339918", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4a419fec-7ee6-4bd4-8115-49436db6cb9f req-9cad4500-c527-401c-bbe7-25a5d0c64391 service nova] Releasing lock "refresh_cache-85b6aa5b-72c1-415f-8552-19d0cd3859d6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:21 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Creating config drive at /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk.config
Aug 26 11:37:21 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6zs8tgcm {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:21 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6zs8tgcm" returned: 0 in 0.081s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Acquiring lock "3c888403-0a31-4494-b822-73f42acadf00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "3c888403-0a31-4494-b822-73f42acadf00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:37:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:21 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:37:21 user nova-compute[73068]: INFO nova.compute.claims [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Claim successful on node user
Aug 26 11:37:21 user nova-compute[73068]: DEBUG nova.network.neutron [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Successfully created port: 5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:37:22 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:37:22 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:37:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.713s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:37:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:37:22 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:37:22 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:37:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:37:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:37:23 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Creating image(s)
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "/opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.006s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "/opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG nova.policy [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f70c9635318145738d4edf74ab71b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4da21f26d942eaa5f6eb075d268200', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.239s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.211s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk 1073741824" returned: 0 in 0.072s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG nova.network.neutron [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Successfully updated port: 5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-3a544457-71bf-4297-9ad1-af19eaeee1ee req-2c21cb10-1863-46ae-be47-fef3cc13967f service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-changed-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-3a544457-71bf-4297-9ad1-af19eaeee1ee req-2c21cb10-1863-46ae-be47-fef3cc13967f service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Refreshing instance network info cache due to event network-changed-5b01dafe-b0f5-420a-9c1f-dfc578e12679. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3a544457-71bf-4297-9ad1-af19eaeee1ee req-2c21cb10-1863-46ae-be47-fef3cc13967f service nova] Acquiring lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3a544457-71bf-4297-9ad1-af19eaeee1ee req-2c21cb10-1863-46ae-be47-fef3cc13967f service nova] Acquired lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG nova.network.neutron [req-3a544457-71bf-4297-9ad1-af19eaeee1ee req-2c21cb10-1863-46ae-be47-fef3cc13967f service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Refreshing network info cache for port 5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG nova.network.neutron [req-3a544457-71bf-4297-9ad1-af19eaeee1ee req-2c21cb10-1863-46ae-be47-fef3cc13967f service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:23 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Cannot resize image /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Ensure instance console log exists: /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-21a77a79-ed5b-427d-86fa-f034c629c78a req-b1ee92e7-d0e3-41ce-a8dd-478ef92f6361 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Received event network-vif-plugged-b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-21a77a79-ed5b-427d-86fa-f034c629c78a req-b1ee92e7-d0e3-41ce-a8dd-478ef92f6361 service nova] Acquiring lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-21a77a79-ed5b-427d-86fa-f034c629c78a req-b1ee92e7-d0e3-41ce-a8dd-478ef92f6361 service nova] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-21a77a79-ed5b-427d-86fa-f034c629c78a req-b1ee92e7-d0e3-41ce-a8dd-478ef92f6361 service nova] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-21a77a79-ed5b-427d-86fa-f034c629c78a req-b1ee92e7-d0e3-41ce-a8dd-478ef92f6361 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] No waiting events found dispatching network-vif-plugged-b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:24 user nova-compute[73068]: WARNING nova.compute.manager [req-21a77a79-ed5b-427d-86fa-f034c629c78a req-b1ee92e7-d0e3-41ce-a8dd-478ef92f6361 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Received unexpected event network-vif-plugged-b2bf177e-b82e-48bd-9f92-9084b2339918 for instance with vm_state building and task_state spawning.
Aug 26 11:37:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG nova.network.neutron [req-3a544457-71bf-4297-9ad1-af19eaeee1ee req-2c21cb10-1863-46ae-be47-fef3cc13967f service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3a544457-71bf-4297-9ad1-af19eaeee1ee req-2c21cb10-1863-46ae-be47-fef3cc13967f service nova] Releasing lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquired lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:24 user nova-compute[73068]: DEBUG nova.network.neutron [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.network.neutron [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Successfully created port: 0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.network.neutron [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Updating instance_info_cache with network_info: [{"id": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "address": "fa:16:3e:7f:de:1f", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01dafe-b0", "ovs_interfaceid": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Releasing lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Instance network_info: |[{"id": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "address": "fa:16:3e:7f:de:1f", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01dafe-b0", "ovs_interfaceid": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Start _get_guest_xml network_info=[{"id": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "address": "fa:16:3e:7f:de:1f", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01dafe-b0", "ovs_interfaceid": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049845.7138731, 85b6aa5b-72c1-415f-8552-19d0cd3859d6 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:25 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] VM Resumed (Lifecycle Event)
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:37:25 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:25 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:25 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Instance spawned successfully.
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-919236364',display_name='tempest-VolumesAdminNegativeTest-server-919236364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-919236364',id=5,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeDgv6hB7R1DY6P9QvdzLjYR/X16/bV+NPCbOIcZzOAmocuOchmKrNM/oTHBes6hqGglsU77dapUrIOE5gfBb7O1uXXVTxk3I5I5bJYw7nLPVebWNFOMFeqxVuiVX9RNg==',key_name='tempest-keypair-1051536643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1112219a9fc34797b1d9f5e872bea350',ramdisk_id='',reservation_id='r-n9bb20yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-175851604',owner_user_name='tempest-VolumesAdminNegativeTest-175851604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed086ebc2de14a0f9b55c87a40f5f621',uuid=3bbfbd87-eda4-4835-bdaa-b3fa5daf9741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "address": "fa:16:3e:7f:de:1f", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01dafe-b0", "ovs_interfaceid": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converting VIF {"id": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "address": "fa:16:3e:7f:de:1f", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01dafe-b0", "ovs_interfaceid": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:de:1f,bridge_name='br-int',has_traffic_filtering=True,id=5b01dafe-b0f5-420a-9c1f-dfc578e12679,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01dafe-b0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.objects.instance [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:25 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049845.7236094, 85b6aa5b-72c1-415f-8552-19d0cd3859d6 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:25 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] VM Started (Lifecycle Event)
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:37:25 user nova-compute[73068]:   <uuid>3bbfbd87-eda4-4835-bdaa-b3fa5daf9741</uuid>
Aug 26 11:37:25 user nova-compute[73068]:   <name>instance-00000005</name>
Aug 26 11:37:25 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:37:25 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:37:25 user nova-compute[73068]:   <metadata>
Aug 26 11:37:25 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:37:25 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:37:25 user nova-compute[73068]:       <nova:name>tempest-VolumesAdminNegativeTest-server-919236364</nova:name>
Aug 26 11:37:25 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:37:25</nova:creationTime>
Aug 26 11:37:25 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:37:25 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:37:25 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:37:25 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:37:25 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:37:25 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:37:25 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:37:25 user nova-compute[73068]:       <nova:owner>
Aug 26 11:37:25 user nova-compute[73068]:         <nova:user uuid="ed086ebc2de14a0f9b55c87a40f5f621">tempest-VolumesAdminNegativeTest-175851604-project-member</nova:user>
Aug 26 11:37:25 user nova-compute[73068]:         <nova:project uuid="1112219a9fc34797b1d9f5e872bea350">tempest-VolumesAdminNegativeTest-175851604</nova:project>
Aug 26 11:37:25 user nova-compute[73068]:       </nova:owner>
Aug 26 11:37:25 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:37:25 user nova-compute[73068]:       <nova:ports>
Aug 26 11:37:25 user nova-compute[73068]:         <nova:port uuid="5b01dafe-b0f5-420a-9c1f-dfc578e12679">
Aug 26 11:37:25 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 11:37:25 user nova-compute[73068]:         </nova:port>
Aug 26 11:37:25 user nova-compute[73068]:       </nova:ports>
Aug 26 11:37:25 user nova-compute[73068]:     </nova:instance>
Aug 26 11:37:25 user nova-compute[73068]:   </metadata>
Aug 26 11:37:25 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:37:25 user nova-compute[73068]:     <system>
Aug 26 11:37:25 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:37:25 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:37:25 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:37:25 user nova-compute[73068]:       <entry name="serial">3bbfbd87-eda4-4835-bdaa-b3fa5daf9741</entry>
Aug 26 11:37:25 user nova-compute[73068]:       <entry name="uuid">3bbfbd87-eda4-4835-bdaa-b3fa5daf9741</entry>
Aug 26 11:37:25 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:37:25 user nova-compute[73068]:     </system>
Aug 26 11:37:25 user nova-compute[73068]:   </sysinfo>
Aug 26 11:37:25 user nova-compute[73068]:   <os>
Aug 26 11:37:25 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:37:25 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:37:25 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:37:25 user nova-compute[73068]:   </os>
Aug 26 11:37:25 user nova-compute[73068]:   <features>
Aug 26 11:37:25 user nova-compute[73068]:     <acpi/>
Aug 26 11:37:25 user nova-compute[73068]:     <apic/>
Aug 26 11:37:25 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:37:25 user nova-compute[73068]:   </features>
Aug 26 11:37:25 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:37:25 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:37:25 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:37:25 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:37:25 user nova-compute[73068]:   </clock>
Aug 26 11:37:25 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:37:25 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:37:25 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:37:25 user nova-compute[73068]:   </cpu>
Aug 26 11:37:25 user nova-compute[73068]:   <devices>
Aug 26 11:37:25 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:37:25 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:37:25 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk"/>
Aug 26 11:37:25 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:37:25 user nova-compute[73068]:     </disk>
Aug 26 11:37:25 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:37:25 user nova-compute[73068]:       <mac address="fa:16:3e:7f:de:1f"/>
Aug 26 11:37:25 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:25 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:37:25 user nova-compute[73068]:       <target dev="tap5b01dafe-b0"/>
Aug 26 11:37:25 user nova-compute[73068]:     </interface>
Aug 26 11:37:25 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:37:25 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/console.log" append="off"/>
Aug 26 11:37:25 user nova-compute[73068]:     </serial>
Aug 26 11:37:25 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:37:25 user nova-compute[73068]:     <video>
Aug 26 11:37:25 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:25 user nova-compute[73068]:     </video>
Aug 26 11:37:25 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:37:25 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:37:25 user nova-compute[73068]:     </rng>
Aug 26 11:37:25 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:37:25 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:37:25 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:37:25 user nova-compute[73068]:     </memballoon>
Aug 26 11:37:25 user nova-compute[73068]:   </devices>
Aug 26 11:37:25 user nova-compute[73068]: </domain>
Aug 26 11:37:25 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-919236364',display_name='tempest-VolumesAdminNegativeTest-server-919236364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-919236364',id=5,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeDgv6hB7R1DY6P9QvdzLjYR/X16/bV+NPCbOIcZzOAmocuOchmKrNM/oTHBes6hqGglsU77dapUrIOE5gfBb7O1uXXVTxk3I5I5bJYw7nLPVebWNFOMFeqxVuiVX9RNg==',key_name='tempest-keypair-1051536643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1112219a9fc34797b1d9f5e872bea350',ramdisk_id='',reservation_id='r-n9bb20yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-175851604',owner_user_name='tempest-VolumesAdminNegativeTest-175851604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed086ebc2de14a0f9b55c87a40f5f621',uuid=3bbfbd87-eda4-4835-bdaa-b3fa5daf9741,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "address": "fa:16:3e:7f:de:1f", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01dafe-b0", "ovs_interfaceid": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converting VIF {"id": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "address": "fa:16:3e:7f:de:1f", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01dafe-b0", "ovs_interfaceid": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:de:1f,bridge_name='br-int',has_traffic_filtering=True,id=5b01dafe-b0f5-420a-9c1f-dfc578e12679,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01dafe-b0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG os_vif [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:de:1f,bridge_name='br-int',has_traffic_filtering=True,id=5b01dafe-b0f5-420a-9c1f-dfc578e12679,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01dafe-b0') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b01dafe-b0, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b01dafe-b0, col_values=(('external_ids', {'iface-id': '5b01dafe-b0f5-420a-9c1f-dfc578e12679', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:de:1f', 'vm-uuid': '3bbfbd87-eda4-4835-bdaa-b3fa5daf9741'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:25 user nova-compute[73068]: INFO os_vif [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:de:1f,bridge_name='br-int',has_traffic_filtering=True,id=5b01dafe-b0f5-420a-9c1f-dfc578e12679,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01dafe-b0')
Aug 26 11:37:25 user nova-compute[73068]: INFO nova.compute.manager [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Took 10.89 seconds to spawn the instance on the hypervisor.
Aug 26 11:37:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:25 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] No VIF found with MAC fa:16:3e:7f:de:1f, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "792b5efb-63fa-4e87-b114-61de6180b2c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.compute.manager [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:37:26 user nova-compute[73068]: INFO nova.compute.manager [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Took 12.39 seconds to build instance.
Aug 26 11:37:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f8952201-41ac-49c2-aa9c-e90513021c53 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.577s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:37:26 user nova-compute[73068]: INFO nova.compute.claims [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Claim successful on node user
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Successfully updated port: 0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Acquiring lock "refresh_cache-3c888403-0a31-4494-b822-73f42acadf00" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Acquired lock "refresh_cache-3c888403-0a31-4494-b822-73f42acadf00" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-aebdedc7-713b-4d1f-b01c-73025603d793 req-9035a8a1-60da-44e4-a27c-ad0e6184aa56 service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Received event network-changed-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-aebdedc7-713b-4d1f-b01c-73025603d793 req-9035a8a1-60da-44e4-a27c-ad0e6184aa56 service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Refreshing instance network info cache due to event network-changed-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aebdedc7-713b-4d1f-b01c-73025603d793 req-9035a8a1-60da-44e4-a27c-ad0e6184aa56 service nova] Acquiring lock "refresh_cache-3c888403-0a31-4494-b822-73f42acadf00" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-d37087ec-d84c-455c-8e2f-58f7474ec23c req-3e50e3e7-a24e-4e8a-ba65-3dd1dfc85e31 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Received event network-vif-plugged-b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d37087ec-d84c-455c-8e2f-58f7474ec23c req-3e50e3e7-a24e-4e8a-ba65-3dd1dfc85e31 service nova] Acquiring lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d37087ec-d84c-455c-8e2f-58f7474ec23c req-3e50e3e7-a24e-4e8a-ba65-3dd1dfc85e31 service nova] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d37087ec-d84c-455c-8e2f-58f7474ec23c req-3e50e3e7-a24e-4e8a-ba65-3dd1dfc85e31 service nova] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-d37087ec-d84c-455c-8e2f-58f7474ec23c req-3e50e3e7-a24e-4e8a-ba65-3dd1dfc85e31 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] No waiting events found dispatching network-vif-plugged-b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:26 user nova-compute[73068]: WARNING nova.compute.manager [req-d37087ec-d84c-455c-8e2f-58f7474ec23c req-3e50e3e7-a24e-4e8a-ba65-3dd1dfc85e31 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Received unexpected event network-vif-plugged-b2bf177e-b82e-48bd-9f92-9084b2339918 for instance with vm_state active and task_state None.
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:37:26 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.network.neutron [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:37:27 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Updating instance_info_cache with network_info: [{"id": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "address": "fa:16:3e:11:40:3b", "network": {"id": "0ae58cc1-a529-47f5-a2de-3f1e2dcf2002", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1371283297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4da21f26d942eaa5f6eb075d268200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6d5120-5b", "ovs_interfaceid": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.policy [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26bb98b2bb864f9096ccc7729f8d2eb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00974a1d61f24b7e89e75608bc052e22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Releasing lock "refresh_cache-3c888403-0a31-4494-b822-73f42acadf00" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Instance network_info: |[{"id": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "address": "fa:16:3e:11:40:3b", "network": {"id": "0ae58cc1-a529-47f5-a2de-3f1e2dcf2002", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1371283297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4da21f26d942eaa5f6eb075d268200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6d5120-5b", "ovs_interfaceid": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aebdedc7-713b-4d1f-b01c-73025603d793 req-9035a8a1-60da-44e4-a27c-ad0e6184aa56 service nova] Acquired lock "refresh_cache-3c888403-0a31-4494-b822-73f42acadf00" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.network.neutron [req-aebdedc7-713b-4d1f-b01c-73025603d793 req-9035a8a1-60da-44e4-a27c-ad0e6184aa56 service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Refreshing network info cache for port 0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Start _get_guest_xml network_info=[{"id": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "address": "fa:16:3e:11:40:3b", "network": {"id": "0ae58cc1-a529-47f5-a2de-3f1e2dcf2002", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1371283297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4da21f26d942eaa5f6eb075d268200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6d5120-5b", "ovs_interfaceid": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:37:27 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:27 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-324139379',display_name='tempest-VolumesActionsTest-instance-324139379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-324139379',id=6,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f4da21f26d942eaa5f6eb075d268200',ramdisk_id='',reservation_id='r-9jm7w9j7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-673651622',owner_user_name='tempest-VolumesActionsTest-673651622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:23Z,user_data=None,user_id='f70c9635318145738d4edf74ab71b3fd',uuid=3c888403-0a31-4494-b822-73f42acadf00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "address": "fa:16:3e:11:40:3b", "network": {"id": "0ae58cc1-a529-47f5-a2de-3f1e2dcf2002", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1371283297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4da21f26d942eaa5f6eb075d268200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6d5120-5b", "ovs_interfaceid": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Converting VIF {"id": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "address": "fa:16:3e:11:40:3b", "network": {"id": "0ae58cc1-a529-47f5-a2de-3f1e2dcf2002", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1371283297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4da21f26d942eaa5f6eb075d268200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6d5120-5b", "ovs_interfaceid": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:40:3b,bridge_name='br-int',has_traffic_filtering=True,id=0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37,network=Network(0ae58cc1-a529-47f5-a2de-3f1e2dcf2002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6d5120-5b') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c888403-0a31-4494-b822-73f42acadf00 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:37:27 user nova-compute[73068]:   <uuid>3c888403-0a31-4494-b822-73f42acadf00</uuid>
Aug 26 11:37:27 user nova-compute[73068]:   <name>instance-00000006</name>
Aug 26 11:37:27 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:37:27 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:37:27 user nova-compute[73068]:   <metadata>
Aug 26 11:37:27 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:37:27 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:37:27 user nova-compute[73068]:       <nova:name>tempest-VolumesActionsTest-instance-324139379</nova:name>
Aug 26 11:37:27 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:37:27</nova:creationTime>
Aug 26 11:37:27 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:37:27 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:37:27 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:37:27 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:37:27 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:37:27 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:37:27 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:37:27 user nova-compute[73068]:       <nova:owner>
Aug 26 11:37:27 user nova-compute[73068]:         <nova:user uuid="f70c9635318145738d4edf74ab71b3fd">tempest-VolumesActionsTest-673651622-project-member</nova:user>
Aug 26 11:37:27 user nova-compute[73068]:         <nova:project uuid="5f4da21f26d942eaa5f6eb075d268200">tempest-VolumesActionsTest-673651622</nova:project>
Aug 26 11:37:27 user nova-compute[73068]:       </nova:owner>
Aug 26 11:37:27 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:37:27 user nova-compute[73068]:       <nova:ports>
Aug 26 11:37:27 user nova-compute[73068]:         <nova:port uuid="0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37">
Aug 26 11:37:27 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 11:37:27 user nova-compute[73068]:         </nova:port>
Aug 26 11:37:27 user nova-compute[73068]:       </nova:ports>
Aug 26 11:37:27 user nova-compute[73068]:     </nova:instance>
Aug 26 11:37:27 user nova-compute[73068]:   </metadata>
Aug 26 11:37:27 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:37:27 user nova-compute[73068]:     <system>
Aug 26 11:37:27 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:37:27 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:37:27 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:37:27 user nova-compute[73068]:       <entry name="serial">3c888403-0a31-4494-b822-73f42acadf00</entry>
Aug 26 11:37:27 user nova-compute[73068]:       <entry name="uuid">3c888403-0a31-4494-b822-73f42acadf00</entry>
Aug 26 11:37:27 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:37:27 user nova-compute[73068]:     </system>
Aug 26 11:37:27 user nova-compute[73068]:   </sysinfo>
Aug 26 11:37:27 user nova-compute[73068]:   <os>
Aug 26 11:37:27 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:37:27 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:37:27 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:37:27 user nova-compute[73068]:   </os>
Aug 26 11:37:27 user nova-compute[73068]:   <features>
Aug 26 11:37:27 user nova-compute[73068]:     <acpi/>
Aug 26 11:37:27 user nova-compute[73068]:     <apic/>
Aug 26 11:37:27 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:37:27 user nova-compute[73068]:   </features>
Aug 26 11:37:27 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:37:27 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:37:27 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:37:27 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:37:27 user nova-compute[73068]:   </clock>
Aug 26 11:37:27 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:37:27 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:37:27 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:37:27 user nova-compute[73068]:   </cpu>
Aug 26 11:37:27 user nova-compute[73068]:   <devices>
Aug 26 11:37:27 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:37:27 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:37:27 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk"/>
Aug 26 11:37:27 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:37:27 user nova-compute[73068]:     </disk>
Aug 26 11:37:27 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:37:27 user nova-compute[73068]:       <mac address="fa:16:3e:11:40:3b"/>
Aug 26 11:37:27 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:27 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:37:27 user nova-compute[73068]:       <target dev="tap0e6d5120-5b"/>
Aug 26 11:37:27 user nova-compute[73068]:     </interface>
Aug 26 11:37:27 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:37:27 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/console.log" append="off"/>
Aug 26 11:37:27 user nova-compute[73068]:     </serial>
Aug 26 11:37:27 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:37:27 user nova-compute[73068]:     <video>
Aug 26 11:37:27 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:27 user nova-compute[73068]:     </video>
Aug 26 11:37:27 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:37:27 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:37:27 user nova-compute[73068]:     </rng>
Aug 26 11:37:27 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:37:27 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:37:27 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:37:27 user nova-compute[73068]:     </memballoon>
Aug 26 11:37:27 user nova-compute[73068]:   </devices>
Aug 26 11:37:27 user nova-compute[73068]: </domain>
Aug 26 11:37:27 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-324139379',display_name='tempest-VolumesActionsTest-instance-324139379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-324139379',id=6,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f4da21f26d942eaa5f6eb075d268200',ramdisk_id='',reservation_id='r-9jm7w9j7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-673651622',owner_user_name='tempest-VolumesActionsTest-673651622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:23Z,user_data=None,user_id='f70c9635318145738d4edf74ab71b3fd',uuid=3c888403-0a31-4494-b822-73f42acadf00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "address": "fa:16:3e:11:40:3b", "network": {"id": "0ae58cc1-a529-47f5-a2de-3f1e2dcf2002", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1371283297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4da21f26d942eaa5f6eb075d268200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6d5120-5b", "ovs_interfaceid": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Converting VIF {"id": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "address": "fa:16:3e:11:40:3b", "network": {"id": "0ae58cc1-a529-47f5-a2de-3f1e2dcf2002", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1371283297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4da21f26d942eaa5f6eb075d268200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6d5120-5b", "ovs_interfaceid": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:40:3b,bridge_name='br-int',has_traffic_filtering=True,id=0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37,network=Network(0ae58cc1-a529-47f5-a2de-3f1e2dcf2002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6d5120-5b') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG os_vif [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:40:3b,bridge_name='br-int',has_traffic_filtering=True,id=0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37,network=Network(0ae58cc1-a529-47f5-a2de-3f1e2dcf2002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6d5120-5b') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e6d5120-5b, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e6d5120-5b, col_values=(('external_ids', {'iface-id': '0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:40:3b', 'vm-uuid': '3c888403-0a31-4494-b822-73f42acadf00'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:37:27 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Creating image(s)
Aug 26 11:37:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "/opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "/opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "/opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:27 user nova-compute[73068]: INFO os_vif [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:40:3b,bridge_name='br-int',has_traffic_filtering=True,id=0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37,network=Network(0ae58cc1-a529-47f5-a2de-3f1e2dcf2002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6d5120-5b')
Aug 26 11:37:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] No VIF found with MAC fa:16:3e:11:40:3b, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.245s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.246s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk 1073741824" returned: 0 in 0.083s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.200s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-aebdedc7-713b-4d1f-b01c-73025603d793 req-9035a8a1-60da-44e4-a27c-ad0e6184aa56 service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Updated VIF entry in instance network info cache for port 0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-aebdedc7-713b-4d1f-b01c-73025603d793 req-9035a8a1-60da-44e4-a27c-ad0e6184aa56 service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Updating instance_info_cache with network_info: [{"id": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "address": "fa:16:3e:11:40:3b", "network": {"id": "0ae58cc1-a529-47f5-a2de-3f1e2dcf2002", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1371283297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4da21f26d942eaa5f6eb075d268200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6d5120-5b", "ovs_interfaceid": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aebdedc7-713b-4d1f-b01c-73025603d793 req-9035a8a1-60da-44e4-a27c-ad0e6184aa56 service nova] Releasing lock "refresh_cache-3c888403-0a31-4494-b822-73f42acadf00" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Cannot resize image /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Ensure instance console log exists: /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Successfully created port: ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:37:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Successfully updated port: ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquired lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-c3a71f4a-9b22-41db-9436-ba1dc9a17bbf req-0a9f250f-c14a-452a-88ce-82c1a5dc2163 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Received event network-changed-ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-c3a71f4a-9b22-41db-9436-ba1dc9a17bbf req-0a9f250f-c14a-452a-88ce-82c1a5dc2163 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Refreshing instance network info cache due to event network-changed-ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c3a71f4a-9b22-41db-9436-ba1dc9a17bbf req-0a9f250f-c14a-452a-88ce-82c1a5dc2163 service nova] Acquiring lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.network.neutron [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Updating instance_info_cache with network_info: [{"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Releasing lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Instance network_info: |[{"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c3a71f4a-9b22-41db-9436-ba1dc9a17bbf req-0a9f250f-c14a-452a-88ce-82c1a5dc2163 service nova] Acquired lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-c3a71f4a-9b22-41db-9436-ba1dc9a17bbf req-0a9f250f-c14a-452a-88ce-82c1a5dc2163 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Refreshing network info cache for port ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Start _get_guest_xml network_info=[{"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:37:31 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:31 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1531375687',display_name='tempest-TestVolumeSwap-server-1531375687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1531375687',id=7,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu8diY0ApGPWRzxdNFNRUfguOIoAEuQYDAfmIrfJT/jzW4+6VpKY/V9lU5GduJzqulVnfUroQueIVc9VvPKU1/dMECRo1faR8e47HJxZdNp4XXEylSe/Vk3yEf9svNsJw==',key_name='tempest-keypair-181362229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00974a1d61f24b7e89e75608bc052e22',ramdisk_id='',reservation_id='r-225bvv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1013364761',owner_user_name='tempest-TestVolumeSwap-1013364761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26bb98b2bb864f9096ccc7729f8d2eb2',uuid=792b5efb-63fa-4e87-b114-61de6180b2c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Converting VIF {"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:19:db,bridge_name='br-int',has_traffic_filtering=True,id=ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe,network=Network(1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6fdf2c-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.objects.instance [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lazy-loading 'pci_devices' on Instance uuid 792b5efb-63fa-4e87-b114-61de6180b2c6 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:37:31 user nova-compute[73068]:   <uuid>792b5efb-63fa-4e87-b114-61de6180b2c6</uuid>
Aug 26 11:37:31 user nova-compute[73068]:   <name>instance-00000007</name>
Aug 26 11:37:31 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:37:31 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:37:31 user nova-compute[73068]:   <metadata>
Aug 26 11:37:31 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:37:31 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:37:31 user nova-compute[73068]:       <nova:name>tempest-TestVolumeSwap-server-1531375687</nova:name>
Aug 26 11:37:31 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:37:31</nova:creationTime>
Aug 26 11:37:31 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:37:31 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:37:31 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:37:31 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:37:31 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:37:31 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:37:31 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:37:31 user nova-compute[73068]:       <nova:owner>
Aug 26 11:37:31 user nova-compute[73068]:         <nova:user uuid="26bb98b2bb864f9096ccc7729f8d2eb2">tempest-TestVolumeSwap-1013364761-project-member</nova:user>
Aug 26 11:37:31 user nova-compute[73068]:         <nova:project uuid="00974a1d61f24b7e89e75608bc052e22">tempest-TestVolumeSwap-1013364761</nova:project>
Aug 26 11:37:31 user nova-compute[73068]:       </nova:owner>
Aug 26 11:37:31 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:37:31 user nova-compute[73068]:       <nova:ports>
Aug 26 11:37:31 user nova-compute[73068]:         <nova:port uuid="ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe">
Aug 26 11:37:31 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 11:37:31 user nova-compute[73068]:         </nova:port>
Aug 26 11:37:31 user nova-compute[73068]:       </nova:ports>
Aug 26 11:37:31 user nova-compute[73068]:     </nova:instance>
Aug 26 11:37:31 user nova-compute[73068]:   </metadata>
Aug 26 11:37:31 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:37:31 user nova-compute[73068]:     <system>
Aug 26 11:37:31 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:37:31 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:37:31 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:37:31 user nova-compute[73068]:       <entry name="serial">792b5efb-63fa-4e87-b114-61de6180b2c6</entry>
Aug 26 11:37:31 user nova-compute[73068]:       <entry name="uuid">792b5efb-63fa-4e87-b114-61de6180b2c6</entry>
Aug 26 11:37:31 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:37:31 user nova-compute[73068]:     </system>
Aug 26 11:37:31 user nova-compute[73068]:   </sysinfo>
Aug 26 11:37:31 user nova-compute[73068]:   <os>
Aug 26 11:37:31 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:37:31 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:37:31 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:37:31 user nova-compute[73068]:   </os>
Aug 26 11:37:31 user nova-compute[73068]:   <features>
Aug 26 11:37:31 user nova-compute[73068]:     <acpi/>
Aug 26 11:37:31 user nova-compute[73068]:     <apic/>
Aug 26 11:37:31 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:37:31 user nova-compute[73068]:   </features>
Aug 26 11:37:31 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:37:31 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:37:31 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:37:31 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:37:31 user nova-compute[73068]:   </clock>
Aug 26 11:37:31 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:37:31 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:37:31 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:37:31 user nova-compute[73068]:   </cpu>
Aug 26 11:37:31 user nova-compute[73068]:   <devices>
Aug 26 11:37:31 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:37:31 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:37:31 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk"/>
Aug 26 11:37:31 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:37:31 user nova-compute[73068]:     </disk>
Aug 26 11:37:31 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:37:31 user nova-compute[73068]:       <mac address="fa:16:3e:2b:19:db"/>
Aug 26 11:37:31 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:31 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:37:31 user nova-compute[73068]:       <target dev="tapca6fdf2c-2c"/>
Aug 26 11:37:31 user nova-compute[73068]:     </interface>
Aug 26 11:37:31 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:37:31 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/console.log" append="off"/>
Aug 26 11:37:31 user nova-compute[73068]:     </serial>
Aug 26 11:37:31 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:37:31 user nova-compute[73068]:     <video>
Aug 26 11:37:31 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:31 user nova-compute[73068]:     </video>
Aug 26 11:37:31 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:37:31 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:37:31 user nova-compute[73068]:     </rng>
Aug 26 11:37:31 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:37:31 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:37:31 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:37:31 user nova-compute[73068]:     </memballoon>
Aug 26 11:37:31 user nova-compute[73068]:   </devices>
Aug 26 11:37:31 user nova-compute[73068]: </domain>
Aug 26 11:37:31 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1531375687',display_name='tempest-TestVolumeSwap-server-1531375687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1531375687',id=7,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu8diY0ApGPWRzxdNFNRUfguOIoAEuQYDAfmIrfJT/jzW4+6VpKY/V9lU5GduJzqulVnfUroQueIVc9VvPKU1/dMECRo1faR8e47HJxZdNp4XXEylSe/Vk3yEf9svNsJw==',key_name='tempest-keypair-181362229',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00974a1d61f24b7e89e75608bc052e22',ramdisk_id='',reservation_id='r-225bvv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1013364761',owner_user_name='tempest-TestVolumeSwap-1013364761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26bb98b2bb864f9096ccc7729f8d2eb2',uuid=792b5efb-63fa-4e87-b114-61de6180b2c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Converting VIF {"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:19:db,bridge_name='br-int',has_traffic_filtering=True,id=ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe,network=Network(1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6fdf2c-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG os_vif [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:19:db,bridge_name='br-int',has_traffic_filtering=True,id=ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe,network=Network(1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6fdf2c-2c') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca6fdf2c-2c, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca6fdf2c-2c, col_values=(('external_ids', {'iface-id': 'ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:19:db', 'vm-uuid': '792b5efb-63fa-4e87-b114-61de6180b2c6'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:31 user nova-compute[73068]: INFO os_vif [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:19:db,bridge_name='br-int',has_traffic_filtering=True,id=ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe,network=Network(1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6fdf2c-2c')
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049851.5060923, 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:31 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] VM Resumed (Lifecycle Event)
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:37:31 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Instance spawned successfully.
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] No VIF found with MAC fa:16:3e:2b:19:db, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:31 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049851.5113697, 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:31 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] VM Started (Lifecycle Event)
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:31 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:31 user nova-compute[73068]: INFO nova.compute.manager [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Took 13.21 seconds to spawn the instance on the hypervisor.
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:31 user nova-compute[73068]: INFO nova.compute.manager [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Took 14.63 seconds to build instance.
Aug 26 11:37:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a4d0171-90b3-413e-9f90-82b4bab3edfd tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.820s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-c3a71f4a-9b22-41db-9436-ba1dc9a17bbf req-0a9f250f-c14a-452a-88ce-82c1a5dc2163 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Updated VIF entry in instance network info cache for port ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-c3a71f4a-9b22-41db-9436-ba1dc9a17bbf req-0a9f250f-c14a-452a-88ce-82c1a5dc2163 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Updating instance_info_cache with network_info: [{"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c3a71f4a-9b22-41db-9436-ba1dc9a17bbf req-0a9f250f-c14a-452a-88ce-82c1a5dc2163 service nova] Releasing lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049852.3693228, 3c888403-0a31-4494-b822-73f42acadf00 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:32 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3c888403-0a31-4494-b822-73f42acadf00] VM Resumed (Lifecycle Event)
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:37:32 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Instance spawned successfully.
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:32 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3c888403-0a31-4494-b822-73f42acadf00] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049852.3725214, 3c888403-0a31-4494-b822-73f42acadf00 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:32 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3c888403-0a31-4494-b822-73f42acadf00] VM Started (Lifecycle Event)
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:32 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3c888403-0a31-4494-b822-73f42acadf00] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:32 user nova-compute[73068]: INFO nova.compute.manager [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Took 9.66 seconds to spawn the instance on the hypervisor.
Aug 26 11:37:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:32 user nova-compute[73068]: INFO nova.compute.manager [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Took 10.97 seconds to build instance.
Aug 26 11:37:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a320d7be-d477-48d4-8fc8-571ceefff7ab tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "3c888403-0a31-4494-b822-73f42acadf00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.100s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-44ebd729-6a14-4adf-8d3c-fceb6f993fae req-cbe14e7c-6c69-49fd-85e7-55d567abd04c service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-44ebd729-6a14-4adf-8d3c-fceb6f993fae req-cbe14e7c-6c69-49fd-85e7-55d567abd04c service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-44ebd729-6a14-4adf-8d3c-fceb6f993fae req-cbe14e7c-6c69-49fd-85e7-55d567abd04c service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-44ebd729-6a14-4adf-8d3c-fceb6f993fae req-cbe14e7c-6c69-49fd-85e7-55d567abd04c service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-44ebd729-6a14-4adf-8d3c-fceb6f993fae req-cbe14e7c-6c69-49fd-85e7-55d567abd04c service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:33 user nova-compute[73068]: WARNING nova.compute.manager [req-44ebd729-6a14-4adf-8d3c-fceb6f993fae req-cbe14e7c-6c69-49fd-85e7-55d567abd04c service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received unexpected event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with vm_state active and task_state None.
Aug 26 11:37:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-11ca4547-f6b6-4021-a9ec-3dd893f82a62 req-331a11f3-960a-465e-8b8a-3857c0ee972b service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11ca4547-f6b6-4021-a9ec-3dd893f82a62 req-331a11f3-960a-465e-8b8a-3857c0ee972b service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11ca4547-f6b6-4021-a9ec-3dd893f82a62 req-331a11f3-960a-465e-8b8a-3857c0ee972b service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11ca4547-f6b6-4021-a9ec-3dd893f82a62 req-331a11f3-960a-465e-8b8a-3857c0ee972b service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-11ca4547-f6b6-4021-a9ec-3dd893f82a62 req-331a11f3-960a-465e-8b8a-3857c0ee972b service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:35 user nova-compute[73068]: WARNING nova.compute.manager [req-11ca4547-f6b6-4021-a9ec-3dd893f82a62 req-331a11f3-960a-465e-8b8a-3857c0ee972b service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received unexpected event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with vm_state active and task_state None.
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049856.1055017, 792b5efb-63fa-4e87-b114-61de6180b2c6 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:36 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] VM Resumed (Lifecycle Event)
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:37:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Instance spawned successfully.
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:36 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049856.1094959, 792b5efb-63fa-4e87-b114-61de6180b2c6 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:36 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] VM Started (Lifecycle Event)
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:36 user nova-compute[73068]: INFO nova.compute.manager [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Took 8.76 seconds to spawn the instance on the hypervisor.
Aug 26 11:37:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:36 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:36 user nova-compute[73068]: INFO nova.compute.manager [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Took 10.15 seconds to build instance.
Aug 26 11:37:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-767c2f4e-ee2a-44f0-a5ee-b04da90cfee1 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.484s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Acquiring lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:37:37 user nova-compute[73068]: INFO nova.compute.claims [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Claim successful on node user
Aug 26 11:37:37 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-0c8c296a-9e95-428c-9a68-f8d2d683fc3f req-f70728e8-578e-494b-ac58-71be04321bae service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Received event network-vif-plugged-ee146c0d-fc52-4402-9c39-b4957128f3ef {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0c8c296a-9e95-428c-9a68-f8d2d683fc3f req-f70728e8-578e-494b-ac58-71be04321bae service nova] Acquiring lock "937978de-8e83-42e7-b906-ccc226924f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0c8c296a-9e95-428c-9a68-f8d2d683fc3f req-f70728e8-578e-494b-ac58-71be04321bae service nova] Lock "937978de-8e83-42e7-b906-ccc226924f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0c8c296a-9e95-428c-9a68-f8d2d683fc3f req-f70728e8-578e-494b-ac58-71be04321bae service nova] Lock "937978de-8e83-42e7-b906-ccc226924f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-0c8c296a-9e95-428c-9a68-f8d2d683fc3f req-f70728e8-578e-494b-ac58-71be04321bae service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] No waiting events found dispatching network-vif-plugged-ee146c0d-fc52-4402-9c39-b4957128f3ef {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:37 user nova-compute[73068]: WARNING nova.compute.manager [req-0c8c296a-9e95-428c-9a68-f8d2d683fc3f req-f70728e8-578e-494b-ac58-71be04321bae service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Received unexpected event network-vif-plugged-ee146c0d-fc52-4402-9c39-b4957128f3ef for instance with vm_state active and task_state None.
Aug 26 11:37:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:37:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:37:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG nova.policy [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef8797cad2dd46a4b63997c05db49299', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a44dcfea3443b3b08867640a2de1e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:37:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Creating image(s)
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Acquiring lock "/opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "/opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "/opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.269s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.302s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk 1073741824" returned: 0 in 0.064s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.232s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Successfully created port: ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Cannot resize image /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Ensure instance console log exists: /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:37:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-8002fbee-1a00-4306-82b4-1d23345a79f3 req-e4f194fc-5e50-4ba9-8042-34c80aef4b0d service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Received event network-vif-plugged-ee146c0d-fc52-4402-9c39-b4957128f3ef {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8002fbee-1a00-4306-82b4-1d23345a79f3 req-e4f194fc-5e50-4ba9-8042-34c80aef4b0d service nova] Acquiring lock "937978de-8e83-42e7-b906-ccc226924f1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8002fbee-1a00-4306-82b4-1d23345a79f3 req-e4f194fc-5e50-4ba9-8042-34c80aef4b0d service nova] Lock "937978de-8e83-42e7-b906-ccc226924f1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8002fbee-1a00-4306-82b4-1d23345a79f3 req-e4f194fc-5e50-4ba9-8042-34c80aef4b0d service nova] Lock "937978de-8e83-42e7-b906-ccc226924f1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-8002fbee-1a00-4306-82b4-1d23345a79f3 req-e4f194fc-5e50-4ba9-8042-34c80aef4b0d service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] No waiting events found dispatching network-vif-plugged-ee146c0d-fc52-4402-9c39-b4957128f3ef {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:40 user nova-compute[73068]: WARNING nova.compute.manager [req-8002fbee-1a00-4306-82b4-1d23345a79f3 req-e4f194fc-5e50-4ba9-8042-34c80aef4b0d service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Received unexpected event network-vif-plugged-ee146c0d-fc52-4402-9c39-b4957128f3ef for instance with vm_state active and task_state None.
Aug 26 11:37:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Successfully updated port: ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:37:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Acquiring lock "refresh_cache-63ea93a3-9a33-42fd-af3a-686b848d0dc1" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Acquired lock "refresh_cache-63ea93a3-9a33-42fd-af3a-686b848d0dc1" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:37:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-fa87b762-17ca-45f7-8168-6d2a36be5bc5 req-4aff758f-0f20-4290-9380-366c24fbc8b4 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Received event network-changed-ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-fa87b762-17ca-45f7-8168-6d2a36be5bc5 req-4aff758f-0f20-4290-9380-366c24fbc8b4 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Refreshing instance network info cache due to event network-changed-ddc74644-b198-466a-8a7a-d9176c59f737. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:37:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fa87b762-17ca-45f7-8168-6d2a36be5bc5 req-4aff758f-0f20-4290-9380-366c24fbc8b4 service nova] Acquiring lock "refresh_cache-63ea93a3-9a33-42fd-af3a-686b848d0dc1" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.network.neutron [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.network.neutron [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Updating instance_info_cache with network_info: [{"id": "ddc74644-b198-466a-8a7a-d9176c59f737", "address": "fa:16:3e:04:90:d1", "network": {"id": "a1c559c7-3c86-48bb-b5ad-fe7637d00998", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2071799706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a44dcfea3443b3b08867640a2de1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc74644-b1", "ovs_interfaceid": "ddc74644-b198-466a-8a7a-d9176c59f737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Releasing lock "refresh_cache-63ea93a3-9a33-42fd-af3a-686b848d0dc1" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Instance network_info: |[{"id": "ddc74644-b198-466a-8a7a-d9176c59f737", "address": "fa:16:3e:04:90:d1", "network": {"id": "a1c559c7-3c86-48bb-b5ad-fe7637d00998", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2071799706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a44dcfea3443b3b08867640a2de1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc74644-b1", "ovs_interfaceid": "ddc74644-b198-466a-8a7a-d9176c59f737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fa87b762-17ca-45f7-8168-6d2a36be5bc5 req-4aff758f-0f20-4290-9380-366c24fbc8b4 service nova] Acquired lock "refresh_cache-63ea93a3-9a33-42fd-af3a-686b848d0dc1" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-fa87b762-17ca-45f7-8168-6d2a36be5bc5 req-4aff758f-0f20-4290-9380-366c24fbc8b4 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Refreshing network info cache for port ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Start _get_guest_xml network_info=[{"id": "ddc74644-b198-466a-8a7a-d9176c59f737", "address": "fa:16:3e:04:90:d1", "network": {"id": "a1c559c7-3c86-48bb-b5ad-fe7637d00998", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2071799706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a44dcfea3443b3b08867640a2de1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc74644-b1", "ovs_interfaceid": "ddc74644-b198-466a-8a7a-d9176c59f737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:37:41 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:41 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1375461997',display_name='tempest-VolumesAssistedSnapshotsTest-server-1375461997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1375461997',id=8,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3C4ZSUOTUPttg2eHd4sb+ubVZpyRDd6BfxyGews9kBA9iYguIj1xQfr9TGWA6xvebsDAX53tBKcYGfb/YA7bjxXIAixAkzT6MLAyFgz/WD+d1UZzFeZEVDxwRAuiNJCA==',key_name='tempest-keypair-1822653618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2a44dcfea3443b3b08867640a2de1e9',ramdisk_id='',reservation_id='r-1vhozwqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-43714610',owner_user_name='tempest-VolumesAssistedSnapshotsTest-43714610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef8797cad2dd46a4b63997c05db49299',uuid=63ea93a3-9a33-42fd-af3a-686b848d0dc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc74644-b198-466a-8a7a-d9176c59f737", "address": "fa:16:3e:04:90:d1", "network": {"id": "a1c559c7-3c86-48bb-b5ad-fe7637d00998", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2071799706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a44dcfea3443b3b08867640a2de1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc74644-b1", "ovs_interfaceid": "ddc74644-b198-466a-8a7a-d9176c59f737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Converting VIF {"id": "ddc74644-b198-466a-8a7a-d9176c59f737", "address": "fa:16:3e:04:90:d1", "network": {"id": "a1c559c7-3c86-48bb-b5ad-fe7637d00998", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2071799706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a44dcfea3443b3b08867640a2de1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc74644-b1", "ovs_interfaceid": "ddc74644-b198-466a-8a7a-d9176c59f737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:90:d1,bridge_name='br-int',has_traffic_filtering=True,id=ddc74644-b198-466a-8a7a-d9176c59f737,network=Network(a1c559c7-3c86-48bb-b5ad-fe7637d00998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc74644-b1') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.objects.instance [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lazy-loading 'pci_devices' on Instance uuid 63ea93a3-9a33-42fd-af3a-686b848d0dc1 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:37:41 user nova-compute[73068]:   <uuid>63ea93a3-9a33-42fd-af3a-686b848d0dc1</uuid>
Aug 26 11:37:41 user nova-compute[73068]:   <name>instance-00000008</name>
Aug 26 11:37:41 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:37:41 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:37:41 user nova-compute[73068]:   <metadata>
Aug 26 11:37:41 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:37:41 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:37:41 user nova-compute[73068]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1375461997</nova:name>
Aug 26 11:37:41 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:37:41</nova:creationTime>
Aug 26 11:37:41 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:37:41 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:37:41 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:37:41 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:37:41 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:37:41 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:37:41 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:37:41 user nova-compute[73068]:       <nova:owner>
Aug 26 11:37:41 user nova-compute[73068]:         <nova:user uuid="ef8797cad2dd46a4b63997c05db49299">tempest-VolumesAssistedSnapshotsTest-43714610-project-member</nova:user>
Aug 26 11:37:41 user nova-compute[73068]:         <nova:project uuid="e2a44dcfea3443b3b08867640a2de1e9">tempest-VolumesAssistedSnapshotsTest-43714610</nova:project>
Aug 26 11:37:41 user nova-compute[73068]:       </nova:owner>
Aug 26 11:37:41 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:37:41 user nova-compute[73068]:       <nova:ports>
Aug 26 11:37:41 user nova-compute[73068]:         <nova:port uuid="ddc74644-b198-466a-8a7a-d9176c59f737">
Aug 26 11:37:41 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 11:37:41 user nova-compute[73068]:         </nova:port>
Aug 26 11:37:41 user nova-compute[73068]:       </nova:ports>
Aug 26 11:37:41 user nova-compute[73068]:     </nova:instance>
Aug 26 11:37:41 user nova-compute[73068]:   </metadata>
Aug 26 11:37:41 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:37:41 user nova-compute[73068]:     <system>
Aug 26 11:37:41 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:37:41 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:37:41 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:37:41 user nova-compute[73068]:       <entry name="serial">63ea93a3-9a33-42fd-af3a-686b848d0dc1</entry>
Aug 26 11:37:41 user nova-compute[73068]:       <entry name="uuid">63ea93a3-9a33-42fd-af3a-686b848d0dc1</entry>
Aug 26 11:37:41 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:37:41 user nova-compute[73068]:     </system>
Aug 26 11:37:41 user nova-compute[73068]:   </sysinfo>
Aug 26 11:37:41 user nova-compute[73068]:   <os>
Aug 26 11:37:41 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:37:41 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:37:41 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:37:41 user nova-compute[73068]:   </os>
Aug 26 11:37:41 user nova-compute[73068]:   <features>
Aug 26 11:37:41 user nova-compute[73068]:     <acpi/>
Aug 26 11:37:41 user nova-compute[73068]:     <apic/>
Aug 26 11:37:41 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:37:41 user nova-compute[73068]:   </features>
Aug 26 11:37:41 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:37:41 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:37:41 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:37:41 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:37:41 user nova-compute[73068]:   </clock>
Aug 26 11:37:41 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:37:41 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:37:41 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:37:41 user nova-compute[73068]:   </cpu>
Aug 26 11:37:41 user nova-compute[73068]:   <devices>
Aug 26 11:37:41 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:37:41 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:37:41 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk"/>
Aug 26 11:37:41 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:37:41 user nova-compute[73068]:     </disk>
Aug 26 11:37:41 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:37:41 user nova-compute[73068]:       <mac address="fa:16:3e:04:90:d1"/>
Aug 26 11:37:41 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:41 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:37:41 user nova-compute[73068]:       <target dev="tapddc74644-b1"/>
Aug 26 11:37:41 user nova-compute[73068]:     </interface>
Aug 26 11:37:41 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:37:41 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/console.log" append="off"/>
Aug 26 11:37:41 user nova-compute[73068]:     </serial>
Aug 26 11:37:41 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:37:41 user nova-compute[73068]:     <video>
Aug 26 11:37:41 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:37:41 user nova-compute[73068]:     </video>
Aug 26 11:37:41 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:37:41 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:37:41 user nova-compute[73068]:     </rng>
Aug 26 11:37:41 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:37:41 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:37:41 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:37:41 user nova-compute[73068]:     </memballoon>
Aug 26 11:37:41 user nova-compute[73068]:   </devices>
Aug 26 11:37:41 user nova-compute[73068]: </domain>
Aug 26 11:37:41 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1375461997',display_name='tempest-VolumesAssistedSnapshotsTest-server-1375461997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1375461997',id=8,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3C4ZSUOTUPttg2eHd4sb+ubVZpyRDd6BfxyGews9kBA9iYguIj1xQfr9TGWA6xvebsDAX53tBKcYGfb/YA7bjxXIAixAkzT6MLAyFgz/WD+d1UZzFeZEVDxwRAuiNJCA==',key_name='tempest-keypair-1822653618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2a44dcfea3443b3b08867640a2de1e9',ramdisk_id='',reservation_id='r-1vhozwqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-43714610',owner_user_name='tempest-VolumesAssistedSnapshotsTest-43714610-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef8797cad2dd46a4b63997c05db49299',uuid=63ea93a3-9a33-42fd-af3a-686b848d0dc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc74644-b198-466a-8a7a-d9176c59f737", "address": "fa:16:3e:04:90:d1", "network": {"id": "a1c559c7-3c86-48bb-b5ad-fe7637d00998", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2071799706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a44dcfea3443b3b08867640a2de1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc74644-b1", "ovs_interfaceid": "ddc74644-b198-466a-8a7a-d9176c59f737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Converting VIF {"id": "ddc74644-b198-466a-8a7a-d9176c59f737", "address": "fa:16:3e:04:90:d1", "network": {"id": "a1c559c7-3c86-48bb-b5ad-fe7637d00998", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2071799706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a44dcfea3443b3b08867640a2de1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc74644-b1", "ovs_interfaceid": "ddc74644-b198-466a-8a7a-d9176c59f737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:90:d1,bridge_name='br-int',has_traffic_filtering=True,id=ddc74644-b198-466a-8a7a-d9176c59f737,network=Network(a1c559c7-3c86-48bb-b5ad-fe7637d00998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc74644-b1') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG os_vif [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:90:d1,bridge_name='br-int',has_traffic_filtering=True,id=ddc74644-b198-466a-8a7a-d9176c59f737,network=Network(a1c559c7-3c86-48bb-b5ad-fe7637d00998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc74644-b1') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddc74644-b1, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapddc74644-b1, col_values=(('external_ids', {'iface-id': 'ddc74644-b198-466a-8a7a-d9176c59f737', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:90:d1', 'vm-uuid': '63ea93a3-9a33-42fd-af3a-686b848d0dc1'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:37:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:41 user nova-compute[73068]: INFO os_vif [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:90:d1,bridge_name='br-int',has_traffic_filtering=True,id=ddc74644-b198-466a-8a7a-d9176c59f737,network=Network(a1c559c7-3c86-48bb-b5ad-fe7637d00998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc74644-b1')
Aug 26 11:37:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:37:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] No VIF found with MAC fa:16:3e:04:90:d1, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:37:42 user nova-compute[73068]: DEBUG nova.network.neutron [req-fa87b762-17ca-45f7-8168-6d2a36be5bc5 req-4aff758f-0f20-4290-9380-366c24fbc8b4 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Updated VIF entry in instance network info cache for port ddc74644-b198-466a-8a7a-d9176c59f737. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:37:42 user nova-compute[73068]: DEBUG nova.network.neutron [req-fa87b762-17ca-45f7-8168-6d2a36be5bc5 req-4aff758f-0f20-4290-9380-366c24fbc8b4 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Updating instance_info_cache with network_info: [{"id": "ddc74644-b198-466a-8a7a-d9176c59f737", "address": "fa:16:3e:04:90:d1", "network": {"id": "a1c559c7-3c86-48bb-b5ad-fe7637d00998", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2071799706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a44dcfea3443b3b08867640a2de1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc74644-b1", "ovs_interfaceid": "ddc74644-b198-466a-8a7a-d9176c59f737", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fa87b762-17ca-45f7-8168-6d2a36be5bc5 req-4aff758f-0f20-4290-9380-366c24fbc8b4 service nova] Releasing lock "refresh_cache-63ea93a3-9a33-42fd-af3a-686b848d0dc1" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] No waiting events found dispatching network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:43 user nova-compute[73068]: WARNING nova.compute.manager [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received unexpected event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 for instance with vm_state active and task_state None.
Aug 26 11:37:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] No waiting events found dispatching network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:43 user nova-compute[73068]: WARNING nova.compute.manager [req-bd90b51f-697d-4104-af95-30f923435001 req-776688db-82c7-4840-bd95-c511d80f44e9 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received unexpected event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 for instance with vm_state active and task_state None.
Aug 26 11:37:43 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Skipping network cache update for instance because it is Building. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 937978de-8e83-42e7-b906-ccc226924f1f {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG nova.compute.manager [req-55e6fe02-9a43-46e8-8101-163436b48960 req-b4560497-ccf1-45be-8379-1d8b27fd7af1 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Received event network-vif-plugged-d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-55e6fe02-9a43-46e8-8101-163436b48960 req-b4560497-ccf1-45be-8379-1d8b27fd7af1 service nova] Acquiring lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-55e6fe02-9a43-46e8-8101-163436b48960 req-b4560497-ccf1-45be-8379-1d8b27fd7af1 service nova] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-55e6fe02-9a43-46e8-8101-163436b48960 req-b4560497-ccf1-45be-8379-1d8b27fd7af1 service nova] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:44 user nova-compute[73068]: DEBUG nova.compute.manager [req-55e6fe02-9a43-46e8-8101-163436b48960 req-b4560497-ccf1-45be-8379-1d8b27fd7af1 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] No waiting events found dispatching network-vif-plugged-d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:44 user nova-compute[73068]: WARNING nova.compute.manager [req-55e6fe02-9a43-46e8-8101-163436b48960 req-b4560497-ccf1-45be-8379-1d8b27fd7af1 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Received unexpected event network-vif-plugged-d5258489-ce6e-41e3-b067-cb26bb791c03 for instance with vm_state active and task_state None.
Aug 26 11:37:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Received event network-vif-plugged-ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] Acquiring lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] No waiting events found dispatching network-vif-plugged-ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:45 user nova-compute[73068]: WARNING nova.compute.manager [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Received unexpected event network-vif-plugged-ddc74644-b198-466a-8a7a-d9176c59f737 for instance with vm_state building and task_state spawning.
Aug 26 11:37:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Received event network-vif-plugged-ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] Acquiring lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] No waiting events found dispatching network-vif-plugged-ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:45 user nova-compute[73068]: WARNING nova.compute.manager [req-241104b1-e440-4c8d-ae11-f4c39799e14d req-f11500a0-9069-48d0-9768-70068a507ac3 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Received unexpected event network-vif-plugged-ddc74644-b198-466a-8a7a-d9176c59f737 for instance with vm_state building and task_state spawning.
Aug 26 11:37:45 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Updating instance_info_cache with network_info: [{"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:37:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049866.344377, 63ea93a3-9a33-42fd-af3a-686b848d0dc1 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:46 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] VM Resumed (Lifecycle Event)
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:37:46 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Instance spawned successfully.
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:37:46 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049866.3455412, 63ea93a3-9a33-42fd-af3a-686b848d0dc1 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:37:46 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] VM Started (Lifecycle Event)
Aug 26 11:37:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:37:46 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:37:46 user nova-compute[73068]: INFO nova.compute.manager [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Took 8.25 seconds to spawn the instance on the hypervisor.
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:46 user nova-compute[73068]: INFO nova.compute.manager [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Took 9.58 seconds to build instance.
Aug 26 11:37:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-02fd4763-5820-4314-95b2-7280f53145d6 tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.747s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-ac229a9a-2401-4e0a-9b9b-51c47be90c2f req-41de8fd5-f0e3-45bb-aa60-f2457afad13b service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Received event network-vif-plugged-d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ac229a9a-2401-4e0a-9b9b-51c47be90c2f req-41de8fd5-f0e3-45bb-aa60-f2457afad13b service nova] Acquiring lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ac229a9a-2401-4e0a-9b9b-51c47be90c2f req-41de8fd5-f0e3-45bb-aa60-f2457afad13b service nova] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ac229a9a-2401-4e0a-9b9b-51c47be90c2f req-41de8fd5-f0e3-45bb-aa60-f2457afad13b service nova] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-ac229a9a-2401-4e0a-9b9b-51c47be90c2f req-41de8fd5-f0e3-45bb-aa60-f2457afad13b service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] No waiting events found dispatching network-vif-plugged-d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:47 user nova-compute[73068]: WARNING nova.compute.manager [req-ac229a9a-2401-4e0a-9b9b-51c47be90c2f req-41de8fd5-f0e3-45bb-aa60-f2457afad13b service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Received unexpected event network-vif-plugged-d5258489-ce6e-41e3-b067-cb26bb791c03 for instance with vm_state active and task_state None.
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:37:48 user nova-compute[73068]: INFO nova.compute.claims [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Claim successful on node user
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.876s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG nova.network.neutron [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:37:49 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:37:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG nova.policy [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bd5b5460f15416c8b7851b85fe3da30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d54004525be4f06a7f9c1dc86ec3248', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:37:49 user nova-compute[73068]: INFO nova.virt.block_device [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Booting with volume d6769dd3-49e3-48fc-8c4f-907a17b55517 at /dev/vda
Aug 26 11:37:49 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:49 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:37:49 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7516MB free_disk=25.855953216552734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:49 user nova-compute[73068]: DEBUG os_brick.utils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:37:49 user nova-compute[73068]: INFO oslo.privsep.daemon [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpri_11gp6/privsep.sock']
Aug 26 11:37:49 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:50 user sudo[83857]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpri_11gp6/privsep.sock
Aug 26 11:37:50 user sudo[83857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 937978de-8e83-42e7-b906-ccc226924f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance fba812b3-7791-463f-9c86-a51ae7a7457d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 85b6aa5b-72c1-415f-8552-19d0cd3859d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3c888403-0a31-4494-b822-73f42acadf00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 792b5efb-63fa-4e87-b114-61de6180b2c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 63ea93a3-9a33-42fd-af3a-686b848d0dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Successfully created port: 2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:37:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Successfully updated port: 2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:37:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "refresh_cache-8a96b57f-dd74-45b8-aa23-a6187dc4bb93" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquired lock "refresh_cache-8a96b57f-dd74-45b8-aa23-a6187dc4bb93" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:37:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-213558c1-2c08-41c1-9bfd-0fb7c54bea88 req-4c116ce7-3d5d-4188-911c-cc038404e54f service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-changed-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-213558c1-2c08-41c1-9bfd-0fb7c54bea88 req-4c116ce7-3d5d-4188-911c-cc038404e54f service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Refreshing instance network info cache due to event network-changed-2000fb73-9c36-4d66-802c-4e5b0aa88226. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:37:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-213558c1-2c08-41c1-9bfd-0fb7c54bea88 req-4c116ce7-3d5d-4188-911c-cc038404e54f service nova] Acquiring lock "refresh_cache-8a96b57f-dd74-45b8-aa23-a6187dc4bb93" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:37:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:37:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:52 user sudo[83857]: pam_unix(sudo:session): session closed for user root
Aug 26 11:37:52 user nova-compute[73068]: DEBUG nova.network.neutron [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Updating instance_info_cache with network_info: [{"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:52 user nova-compute[73068]: INFO oslo.privsep.daemon [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Spawned new privsep daemon via rootwrap
Aug 26 11:37:52 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 11:37:52 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 11:37:52 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 26 11:37:52 user nova-compute[73068]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83861
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2efe3fb-2797-432d-8639-e71bd334554a]: (2,) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Releasing lock "refresh_cache-8a96b57f-dd74-45b8-aa23-a6187dc4bb93" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG nova.compute.manager [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Instance network_info: |[{"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-213558c1-2c08-41c1-9bfd-0fb7c54bea88 req-4c116ce7-3d5d-4188-911c-cc038404e54f service nova] Acquired lock "refresh_cache-8a96b57f-dd74-45b8-aa23-a6187dc4bb93" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG nova.network.neutron [req-213558c1-2c08-41c1-9bfd-0fb7c54bea88 req-4c116ce7-3d5d-4188-911c-cc038404e54f service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Refreshing network info cache for port 2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[416ac63c-030e-45ef-97ae-8969a4325e4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:37:52 user nova-compute[73068]: WARNING os_brick.initiator.connectors.nvmeof [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 26 11:37:52 user nova-compute[73068]: DEBUG nova.compute.manager [req-3c8e9881-ac07-4401-b87a-f8b0e588be00 req-fea7ca18-feca-4031-8260-3fbad8c77a0f service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Received event network-vif-plugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3c8e9881-ac07-4401-b87a-f8b0e588be00 req-fea7ca18-feca-4031-8260-3fbad8c77a0f service nova] Acquiring lock "3c888403-0a31-4494-b822-73f42acadf00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3c8e9881-ac07-4401-b87a-f8b0e588be00 req-fea7ca18-feca-4031-8260-3fbad8c77a0f service nova] Lock "3c888403-0a31-4494-b822-73f42acadf00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3c8e9881-ac07-4401-b87a-f8b0e588be00 req-fea7ca18-feca-4031-8260-3fbad8c77a0f service nova] Lock "3c888403-0a31-4494-b822-73f42acadf00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG nova.compute.manager [req-3c8e9881-ac07-4401-b87a-f8b0e588be00 req-fea7ca18-feca-4031-8260-3fbad8c77a0f service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] No waiting events found dispatching network-vif-plugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:52 user nova-compute[73068]: WARNING nova.compute.manager [req-3c8e9881-ac07-4401-b87a-f8b0e588be00 req-fea7ca18-feca-4031-8260-3fbad8c77a0f service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Received unexpected event network-vif-plugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 for instance with vm_state active and task_state None.
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cc089a-800b-4d8c-9dc2-fea4fe0a64d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[013e9321-def8-42f1-ad54-fa85141a9752]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea0a61b-881a-4328-9699-b7d7e1b82420]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:37:52 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:37:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7639132-1665-42b4-b5a6-0f199dbdef02]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG os_brick.utils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] <== get_connector_properties: return (2486ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Updating existing volume attachment record: ca03688e-8bb1-4e1c-9afb-d45168f08b25 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG nova.network.neutron [req-213558c1-2c08-41c1-9bfd-0fb7c54bea88 req-4c116ce7-3d5d-4188-911c-cc038404e54f service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Updated VIF entry in instance network info cache for port 2000fb73-9c36-4d66-802c-4e5b0aa88226. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:37:52 user nova-compute[73068]: DEBUG nova.network.neutron [req-213558c1-2c08-41c1-9bfd-0fb7c54bea88 req-4c116ce7-3d5d-4188-911c-cc038404e54f service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Updating instance_info_cache with network_info: [{"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:37:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-213558c1-2c08-41c1-9bfd-0fb7c54bea88 req-4c116ce7-3d5d-4188-911c-cc038404e54f service nova] Releasing lock "refresh_cache-8a96b57f-dd74-45b8-aa23-a6187dc4bb93" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Received event network-vif-plugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] Acquiring lock "3c888403-0a31-4494-b822-73f42acadf00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] Lock "3c888403-0a31-4494-b822-73f42acadf00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] Lock "3c888403-0a31-4494-b822-73f42acadf00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] No waiting events found dispatching network-vif-plugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:54 user nova-compute[73068]: WARNING nova.compute.manager [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Received unexpected event network-vif-plugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 for instance with vm_state active and task_state None.
Aug 26 11:37:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Received event network-vif-plugged-ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] Acquiring lock "792b5efb-63fa-4e87-b114-61de6180b2c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] No waiting events found dispatching network-vif-plugged-ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:54 user nova-compute[73068]: WARNING nova.compute.manager [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Received unexpected event network-vif-plugged-ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe for instance with vm_state active and task_state None.
Aug 26 11:37:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Received event network-vif-plugged-ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] Acquiring lock "792b5efb-63fa-4e87-b114-61de6180b2c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:37:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] No waiting events found dispatching network-vif-plugged-ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:37:54 user nova-compute[73068]: WARNING nova.compute.manager [req-be2660f8-27b6-4fe1-9f1f-d61a6baf4768 req-db54d30e-bec8-4cc3-9ed5-daba2875cdd4 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Received unexpected event network-vif-plugged-ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe for instance with vm_state active and task_state None.
Aug 26 11:37:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:37:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:38:04 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Creating image(s)
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Ensure instance console log exists: /opt/stack/data/nova/instances/8a96b57f-dd74-45b8-aa23-a6187dc4bb93/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Start _get_guest_xml network_info=[{"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'ca03688e-8bb1-4e1c-9afb-d45168f08b25', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFyOtqMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a96b57f-dd74-45b8-aa23-a6187dc4bb93', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6769dd3-49e3-48fc-8c4f-907a17b55517', 'serial': 'd6769dd3-49e3-48fc-8c4f-907a17b55517'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:38:04 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:38:04 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connector [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Factory for ISCSI on None {{(pid=73068) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFyOtqMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:38:04 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:38:04 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:38:04 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3583b9-0310-4e8d-8e75-fd4104ea72ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:38:04 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a1f940-07f7-4913-83d4-a5a5905a111b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517] added
Aug 26 11:38:04 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cc6c9a-82e9-4439-93cc-9fc5789c470b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[28789d9d-3397-4c54-bb85-6c9b8f04d1b0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFyOtqMN {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFyOtqMN" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dd7857-265e-4128-a8ea-2e222e68a5bd]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JFyOtqMN'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0159f1e2-cd1a-4b4d-9f6b-d6fa9b1c6417]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0394002c-19c5-4514-80a4-a5f95bda992c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 11:38:04 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 11:38:04 user nova-compute[73068]:  {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:38:04 user nova-compute[73068]: WARNING os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 11:38:04 user nova-compute[73068]: 
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[42921378-12ea-4032-95c4-872a875067bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260]
Aug 26 11:38:04 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260] successful.
Aug 26 11:38:04 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b062ec3-5ad8-4ea0-a710-a7d8bb4598d7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[69945d3f-4035-4cff-b1c3-121844e54bfd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:38:04 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:38:04 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4113c66b-1c59-4ec3-9e8d-9791c474e522]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFyOtqMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:38:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26634613236373161', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634613236373161', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-800782579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-800782579',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/ZA4n0oqdwxudhPdUfBqQgXyjpwc/T+oPc5U+vqaCyvzEcT70JQD8EejyFZzqJOf+nGQXLZHuQHaE86x94DM7IeG2QP7b5azKYS86x18eGLwCVUieLMNu0xFns9T2eA==',key_name='tempest-keypair-1654929932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d54004525be4f06a7f9c1dc86ec3248',ramdisk_id='',reservation_id='r-5ar52vv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1026667147',owner_user_name='tempest-ServerActionsV293TestJSON-1026667147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bd5b5460f15416c8b7851b85fe3da30',uuid=8a96b57f-dd74-45b8-aa23-a6187dc4bb93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converting VIF {"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG nova.objects.instance [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:38:05 user nova-compute[73068]:   <uuid>8a96b57f-dd74-45b8-aa23-a6187dc4bb93</uuid>
Aug 26 11:38:05 user nova-compute[73068]:   <name>instance-00000009</name>
Aug 26 11:38:05 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:38:05 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:38:05 user nova-compute[73068]:   <metadata>
Aug 26 11:38:05 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:38:05 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:38:05 user nova-compute[73068]:       <nova:name>tempest-ServerActionsV293TestJSON-server-800782579</nova:name>
Aug 26 11:38:05 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:38:04</nova:creationTime>
Aug 26 11:38:05 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:38:05 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:38:05 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:38:05 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:38:05 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:38:05 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:38:05 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:38:05 user nova-compute[73068]:       <nova:owner>
Aug 26 11:38:05 user nova-compute[73068]:         <nova:user uuid="4bd5b5460f15416c8b7851b85fe3da30">tempest-ServerActionsV293TestJSON-1026667147-project-member</nova:user>
Aug 26 11:38:05 user nova-compute[73068]:         <nova:project uuid="6d54004525be4f06a7f9c1dc86ec3248">tempest-ServerActionsV293TestJSON-1026667147</nova:project>
Aug 26 11:38:05 user nova-compute[73068]:       </nova:owner>
Aug 26 11:38:05 user nova-compute[73068]:       <nova:ports>
Aug 26 11:38:05 user nova-compute[73068]:         <nova:port uuid="2000fb73-9c36-4d66-802c-4e5b0aa88226">
Aug 26 11:38:05 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 11:38:05 user nova-compute[73068]:         </nova:port>
Aug 26 11:38:05 user nova-compute[73068]:       </nova:ports>
Aug 26 11:38:05 user nova-compute[73068]:     </nova:instance>
Aug 26 11:38:05 user nova-compute[73068]:   </metadata>
Aug 26 11:38:05 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:38:05 user nova-compute[73068]:     <system>
Aug 26 11:38:05 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:38:05 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:38:05 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:38:05 user nova-compute[73068]:       <entry name="serial">8a96b57f-dd74-45b8-aa23-a6187dc4bb93</entry>
Aug 26 11:38:05 user nova-compute[73068]:       <entry name="uuid">8a96b57f-dd74-45b8-aa23-a6187dc4bb93</entry>
Aug 26 11:38:05 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:38:05 user nova-compute[73068]:     </system>
Aug 26 11:38:05 user nova-compute[73068]:   </sysinfo>
Aug 26 11:38:05 user nova-compute[73068]:   <os>
Aug 26 11:38:05 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:38:05 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:38:05 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:38:05 user nova-compute[73068]:   </os>
Aug 26 11:38:05 user nova-compute[73068]:   <features>
Aug 26 11:38:05 user nova-compute[73068]:     <acpi/>
Aug 26 11:38:05 user nova-compute[73068]:     <apic/>
Aug 26 11:38:05 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:38:05 user nova-compute[73068]:   </features>
Aug 26 11:38:05 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:38:05 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:38:05 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:38:05 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:38:05 user nova-compute[73068]:   </clock>
Aug 26 11:38:05 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:38:05 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:38:05 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:38:05 user nova-compute[73068]:   </cpu>
Aug 26 11:38:05 user nova-compute[73068]:   <devices>
Aug 26 11:38:05 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:38:05 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:38:05 user nova-compute[73068]:       <source dev="/dev/sdb"/>
Aug 26 11:38:05 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:38:05 user nova-compute[73068]:       <serial>d6769dd3-49e3-48fc-8c4f-907a17b55517</serial>
Aug 26 11:38:05 user nova-compute[73068]:     </disk>
Aug 26 11:38:05 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:38:05 user nova-compute[73068]:       <mac address="fa:16:3e:f6:aa:bd"/>
Aug 26 11:38:05 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:38:05 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:38:05 user nova-compute[73068]:       <target dev="tap2000fb73-9c"/>
Aug 26 11:38:05 user nova-compute[73068]:     </interface>
Aug 26 11:38:05 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:38:05 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/8a96b57f-dd74-45b8-aa23-a6187dc4bb93/console.log" append="off"/>
Aug 26 11:38:05 user nova-compute[73068]:     </serial>
Aug 26 11:38:05 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:38:05 user nova-compute[73068]:     <video>
Aug 26 11:38:05 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:38:05 user nova-compute[73068]:     </video>
Aug 26 11:38:05 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:38:05 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:38:05 user nova-compute[73068]:     </rng>
Aug 26 11:38:05 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:38:05 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:38:05 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:38:05 user nova-compute[73068]:     </memballoon>
Aug 26 11:38:05 user nova-compute[73068]:   </devices>
Aug 26 11:38:05 user nova-compute[73068]: </domain>
Aug 26 11:38:05 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-800782579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-800782579',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/ZA4n0oqdwxudhPdUfBqQgXyjpwc/T+oPc5U+vqaCyvzEcT70JQD8EejyFZzqJOf+nGQXLZHuQHaE86x94DM7IeG2QP7b5azKYS86x18eGLwCVUieLMNu0xFns9T2eA==',key_name='tempest-keypair-1654929932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6d54004525be4f06a7f9c1dc86ec3248',ramdisk_id='',reservation_id='r-5ar52vv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1026667147',owner_user_name='tempest-ServerActionsV293TestJSON-1026667147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bd5b5460f15416c8b7851b85fe3da30',uuid=8a96b57f-dd74-45b8-aa23-a6187dc4bb93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converting VIF {"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG os_vif [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2000fb73-9c, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2000fb73-9c, col_values=(('external_ids', {'iface-id': '2000fb73-9c36-4d66-802c-4e5b0aa88226', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:aa:bd', 'vm-uuid': '8a96b57f-dd74-45b8-aa23-a6187dc4bb93'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:05 user nova-compute[73068]: INFO os_vif [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c')
Aug 26 11:38:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:38:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] No VIF found with MAC fa:16:3e:f6:aa:bd, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:38:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-60207719-d58f-47de-b39c-3ba47283b52f req-c1054843-d456-4e44-8548-1ad22751ee3a service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-60207719-d58f-47de-b39c-3ba47283b52f req-c1054843-d456-4e44-8548-1ad22751ee3a service nova] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-60207719-d58f-47de-b39c-3ba47283b52f req-c1054843-d456-4e44-8548-1ad22751ee3a service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-60207719-d58f-47de-b39c-3ba47283b52f req-c1054843-d456-4e44-8548-1ad22751ee3a service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-60207719-d58f-47de-b39c-3ba47283b52f req-c1054843-d456-4e44-8548-1ad22751ee3a service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] No waiting events found dispatching network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:38:07 user nova-compute[73068]: WARNING nova.compute.manager [req-60207719-d58f-47de-b39c-3ba47283b52f req-c1054843-d456-4e44-8548-1ad22751ee3a service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received unexpected event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 for instance with vm_state building and task_state spawning.
Aug 26 11:38:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049889.2875764, 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:38:09 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] VM Resumed (Lifecycle Event)
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:38:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Instance spawned successfully.
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:09 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049889.290099, 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:38:09 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] VM Started (Lifecycle Event)
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:38:09 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:38:09 user nova-compute[73068]: INFO nova.compute.manager [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Took 5.09 seconds to spawn the instance on the hypervisor.
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:38:09 user nova-compute[73068]: INFO nova.compute.manager [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Took 21.49 seconds to build instance.
Aug 26 11:38:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9d4f46e8-0f4d-4a40-9332-4cd9c9fec1b0 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.680s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.compute.manager [req-e2b78385-e28c-4167-9db4-b3650fee1fda req-ad7d6ef9-e787-40e0-90c9-6f9409470b69 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e2b78385-e28c-4167-9db4-b3650fee1fda req-ad7d6ef9-e787-40e0-90c9-6f9409470b69 service nova] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e2b78385-e28c-4167-9db4-b3650fee1fda req-ad7d6ef9-e787-40e0-90c9-6f9409470b69 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e2b78385-e28c-4167-9db4-b3650fee1fda req-ad7d6ef9-e787-40e0-90c9-6f9409470b69 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:09 user nova-compute[73068]: DEBUG nova.compute.manager [req-e2b78385-e28c-4167-9db4-b3650fee1fda req-ad7d6ef9-e787-40e0-90c9-6f9409470b69 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] No waiting events found dispatching network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:38:09 user nova-compute[73068]: WARNING nova.compute.manager [req-e2b78385-e28c-4167-9db4-b3650fee1fda req-ad7d6ef9-e787-40e0-90c9-6f9409470b69 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received unexpected event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 for instance with vm_state active and task_state None.
Aug 26 11:38:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:38:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:38:18 user nova-compute[73068]: INFO nova.compute.claims [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Claim successful on node user
Aug 26 11:38:18 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:38:18 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:38:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:38:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:38:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:38:19 user nova-compute[73068]: INFO nova.virt.block_device [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Booting with volume 4cd96df1-c124-47d4-a50f-24916b465e63 at /dev/vda
Aug 26 11:38:19 user nova-compute[73068]: DEBUG os_brick.utils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e71d3b3-d61b-4a2f-baac-6a2c8348284e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b19d94-28fc-4cfe-b4d3-a469910a9d81]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50055324-5ef5-4bd9-b75f-7f5de98b5873]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[825daf9a-b139-4f45-a9c2-a896acda9809]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:19 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:38:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddf1e76-473a-43d8-8c36-77bd4ec291a7]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG os_brick.utils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating existing volume attachment record: a49af3d0-f2dc-40cf-a3b3-6f26fb753999 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:38:19 user nova-compute[73068]: DEBUG nova.policy [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38f47dcfe8a74fe1a7138cb072f4dc3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39175659a66542958d7d93274ee45cde', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:38:20 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully created port: 0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:38:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:38:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:38:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:38:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:38:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:38:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:20 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully created port: 23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:38:22 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully created port: 3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:38:23 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully created port: c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:38:24 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully created port: 9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:38:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:25 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully updated port: 0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:25 user nova-compute[73068]: DEBUG nova.compute.manager [req-c84ab623-6187-48b3-8ffd-ca5c6f2a5831 req-df8994b2-3916-4b27-828d-e4d74591f380 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-changed-0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:25 user nova-compute[73068]: DEBUG nova.compute.manager [req-c84ab623-6187-48b3-8ffd-ca5c6f2a5831 req-df8994b2-3916-4b27-828d-e4d74591f380 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing instance network info cache due to event network-changed-0627ade3-5789-4bab-8e59-684ca2e6b871. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c84ab623-6187-48b3-8ffd-ca5c6f2a5831 req-df8994b2-3916-4b27-828d-e4d74591f380 service nova] Acquiring lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c84ab623-6187-48b3-8ffd-ca5c6f2a5831 req-df8994b2-3916-4b27-828d-e4d74591f380 service nova] Acquired lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:25 user nova-compute[73068]: DEBUG nova.network.neutron [req-c84ab623-6187-48b3-8ffd-ca5c6f2a5831 req-df8994b2-3916-4b27-828d-e4d74591f380 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing network info cache for port 0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:25 user nova-compute[73068]: DEBUG nova.network.neutron [req-c84ab623-6187-48b3-8ffd-ca5c6f2a5831 req-df8994b2-3916-4b27-828d-e4d74591f380 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:26 user nova-compute[73068]: DEBUG nova.network.neutron [req-c84ab623-6187-48b3-8ffd-ca5c6f2a5831 req-df8994b2-3916-4b27-828d-e4d74591f380 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c84ab623-6187-48b3-8ffd-ca5c6f2a5831 req-df8994b2-3916-4b27-828d-e4d74591f380 service nova] Releasing lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:26 user nova-compute[73068]: DEBUG nova.compute.manager [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:38:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:26 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:38:26 user nova-compute[73068]: INFO nova.compute.claims [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Claim successful on node user
Aug 26 11:38:26 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully updated port: 542f57ca-0e66-4492-a4d5-1fbbd78d5a3d {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:38:27 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.policy [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f8b15786de34d59b9d0b2f061640b56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3d06304213c49a58e2896200963e7f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:38:27 user nova-compute[73068]: INFO nova.virt.block_device [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Booting with volume 0ae7a199-f84b-49aa-9543-be68e4b9e914 at /dev/vda
Aug 26 11:38:27 user nova-compute[73068]: DEBUG os_brick.utils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c581e96d-7621-4004-b6b9-9fab3de19a11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e556d09e-cfd7-4310-be7f-6937be3097bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully updated port: 4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2133dc1c-b817-428f-b77b-3fdcee6c973f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c284c0f-2396-4ad7-8859-1f526d0d1715]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:27 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f787a7-737f-458f-889a-fdd50cae232b]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG os_brick.utils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating existing volume attachment record: 30166a87-ebd8-4562-aa49-2c9767cdff37 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-changed-542f57ca-0e66-4492-a4d5-1fbbd78d5a3d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing instance network info cache due to event network-changed-542f57ca-0e66-4492-a4d5-1fbbd78d5a3d. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] Acquiring lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] Acquired lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:27 user nova-compute[73068]: DEBUG nova.network.neutron [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing network info cache for port 542f57ca-0e66-4492-a4d5-1fbbd78d5a3d {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully created port: 13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully updated port: 23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] Releasing lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-changed-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing instance network info cache due to event network-changed-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] Acquiring lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] Acquired lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing network info cache for port 4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully created port: e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c14debc-902f-4344-b1ce-6c39ba968cc3 req-4b1d3c74-ee9a-4866-beb5-a21cd57e8fe4 service nova] Releasing lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully updated port: 3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-3b6b6e35-dac8-45d4-b96c-959ca86fb7e5 req-de9614f0-ac5c-467d-915e-6ca529ef00ca service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-changed-3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-3b6b6e35-dac8-45d4-b96c-959ca86fb7e5 req-de9614f0-ac5c-467d-915e-6ca529ef00ca service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing instance network info cache due to event network-changed-3b676f78-696f-4ef3-8529-a3892bf0aeb1. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3b6b6e35-dac8-45d4-b96c-959ca86fb7e5 req-de9614f0-ac5c-467d-915e-6ca529ef00ca service nova] Acquiring lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3b6b6e35-dac8-45d4-b96c-959ca86fb7e5 req-de9614f0-ac5c-467d-915e-6ca529ef00ca service nova] Acquired lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG nova.network.neutron [req-3b6b6e35-dac8-45d4-b96c-959ca86fb7e5 req-de9614f0-ac5c-467d-915e-6ca529ef00ca service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing network info cache for port 3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG nova.network.neutron [req-3b6b6e35-dac8-45d4-b96c-959ca86fb7e5 req-de9614f0-ac5c-467d-915e-6ca529ef00ca service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully created port: 10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG nova.network.neutron [req-3b6b6e35-dac8-45d4-b96c-959ca86fb7e5 req-de9614f0-ac5c-467d-915e-6ca529ef00ca service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3b6b6e35-dac8-45d4-b96c-959ca86fb7e5 req-de9614f0-ac5c-467d-915e-6ca529ef00ca service nova] Releasing lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully updated port: c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-e3581cb8-e34a-4b22-ad6b-78dbd197ce1e req-234e47d7-d754-46fd-bbef-0a453e57bac1 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-changed-23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-e3581cb8-e34a-4b22-ad6b-78dbd197ce1e req-234e47d7-d754-46fd-bbef-0a453e57bac1 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing instance network info cache due to event network-changed-23a55e92-430b-4393-8957-cfc9dce489be. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e3581cb8-e34a-4b22-ad6b-78dbd197ce1e req-234e47d7-d754-46fd-bbef-0a453e57bac1 service nova] Acquiring lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e3581cb8-e34a-4b22-ad6b-78dbd197ce1e req-234e47d7-d754-46fd-bbef-0a453e57bac1 service nova] Acquired lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:29 user nova-compute[73068]: DEBUG nova.network.neutron [req-e3581cb8-e34a-4b22-ad6b-78dbd197ce1e req-234e47d7-d754-46fd-bbef-0a453e57bac1 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing network info cache for port 23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG nova.network.neutron [req-e3581cb8-e34a-4b22-ad6b-78dbd197ce1e req-234e47d7-d754-46fd-bbef-0a453e57bac1 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully created port: 27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG nova.network.neutron [req-e3581cb8-e34a-4b22-ad6b-78dbd197ce1e req-234e47d7-d754-46fd-bbef-0a453e57bac1 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e3581cb8-e34a-4b22-ad6b-78dbd197ce1e req-234e47d7-d754-46fd-bbef-0a453e57bac1 service nova] Releasing lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Successfully updated port: 9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquired lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully created port: 6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:30 user nova-compute[73068]: INFO nova.virt.block_device [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Booting with volume f1da6ab8-9518-4dfa-be22-538d76200b8d at /dev/vdb
Aug 26 11:38:30 user nova-compute[73068]: DEBUG os_brick.utils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ffe59c-e8fa-4c88-b8c5-fb813ae527f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e98507-4ed2-4431-b008-494001d6ac2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d169b87-2d5c-490d-915d-0f762cdbfd3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[44704c50-5479-4c49-a904-d6f05cceb45c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:31 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5009de0a-08cc-4393-b530-0eea1bd56b62]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG os_brick.utils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating existing volume attachment record: 5d5b22d1-edb3-4ee1-81f5-33ac77f1cf50 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-changed-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing instance network info cache due to event network-changed-c1f2ea89-5b9c-46ba-a9a9-16e75263b153. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] Acquiring lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully updated port: 13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-0bfa0c24-38dc-4a82-889f-229d4393b1dc req-900b6770-5219-43a6-b2eb-71ba0d46e7b3 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-changed-13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-0bfa0c24-38dc-4a82-889f-229d4393b1dc req-900b6770-5219-43a6-b2eb-71ba0d46e7b3 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing instance network info cache due to event network-changed-13c74443-704c-42ea-a6c9-318fdb45bf39. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0bfa0c24-38dc-4a82-889f-229d4393b1dc req-900b6770-5219-43a6-b2eb-71ba0d46e7b3 service nova] Acquiring lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0bfa0c24-38dc-4a82-889f-229d4393b1dc req-900b6770-5219-43a6-b2eb-71ba0d46e7b3 service nova] Acquired lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-0bfa0c24-38dc-4a82-889f-229d4393b1dc req-900b6770-5219-43a6-b2eb-71ba0d46e7b3 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing network info cache for port 13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-0bfa0c24-38dc-4a82-889f-229d4393b1dc req-900b6770-5219-43a6-b2eb-71ba0d46e7b3 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-0bfa0c24-38dc-4a82-889f-229d4393b1dc req-900b6770-5219-43a6-b2eb-71ba0d46e7b3 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0bfa0c24-38dc-4a82-889f-229d4393b1dc req-900b6770-5219-43a6-b2eb-71ba0d46e7b3 service nova] Releasing lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:32 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully updated port: b8349c53-2931-4166-9c38-83acbd21a526 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully updated port: 7d526e58-f0c8-4959-a451-267b715b2eff {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.network.neutron [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [{"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Releasing lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.compute.manager [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Instance network_info: |[{"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] Acquired lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing network info cache for port c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-changed-b8349c53-2931-4166-9c38-83acbd21a526 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing instance network info cache due to event network-changed-b8349c53-2931-4166-9c38-83acbd21a526. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] Acquiring lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] Acquired lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing network info cache for port b8349c53-2931-4166-9c38-83acbd21a526 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updated VIF entry in instance network info cache for port c1f2ea89-5b9c-46ba-a9a9-16e75263b153. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [{"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] Releasing lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-changed-9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing instance network info cache due to event network-changed-9106173f-4454-446d-a434-3222ed390edf. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] Acquiring lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] Acquired lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing network info cache for port 9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully updated port: e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] Releasing lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-changed-7d526e58-f0c8-4959-a451-267b715b2eff {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing instance network info cache due to event network-changed-7d526e58-f0c8-4959-a451-267b715b2eff. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] Acquiring lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] Acquired lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing network info cache for port 7d526e58-f0c8-4959-a451-267b715b2eff {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updated VIF entry in instance network info cache for port 9106173f-4454-446d-a434-3222ed390edf. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [{"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-66e450b9-2eb9-40b0-bc6f-812f9e6ae31f req-cd87982c-9fee-40cf-ab99-a435d46d9d55 service nova] Releasing lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7e6d3cd2-bf8f-4a30-a5f1-e5232da908e6 req-440a95d5-5f4c-4e0e-b0e2-e99dfa7ccd67 service nova] Releasing lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully updated port: 10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-104374b0-b47f-4f62-819b-24d2774b94e2 req-8b4ba8fb-c72f-4250-a324-4947f531a0ab service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-changed-10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-104374b0-b47f-4f62-819b-24d2774b94e2 req-8b4ba8fb-c72f-4250-a324-4947f531a0ab service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing instance network info cache due to event network-changed-10b083eb-5813-4a51-8e7d-9fd1afbdd97b. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-104374b0-b47f-4f62-819b-24d2774b94e2 req-8b4ba8fb-c72f-4250-a324-4947f531a0ab service nova] Acquiring lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-104374b0-b47f-4f62-819b-24d2774b94e2 req-8b4ba8fb-c72f-4250-a324-4947f531a0ab service nova] Acquired lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-104374b0-b47f-4f62-819b-24d2774b94e2 req-8b4ba8fb-c72f-4250-a324-4947f531a0ab service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing network info cache for port 10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-104374b0-b47f-4f62-819b-24d2774b94e2 req-8b4ba8fb-c72f-4250-a324-4947f531a0ab service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-104374b0-b47f-4f62-819b-24d2774b94e2 req-8b4ba8fb-c72f-4250-a324-4947f531a0ab service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-104374b0-b47f-4f62-819b-24d2774b94e2 req-8b4ba8fb-c72f-4250-a324-4947f531a0ab service nova] Releasing lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully updated port: 27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-65708ae6-204b-441e-b499-1896af188ce5 req-42c23463-dff0-4d8d-9dc6-9a08358af9a8 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-changed-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-65708ae6-204b-441e-b499-1896af188ce5 req-42c23463-dff0-4d8d-9dc6-9a08358af9a8 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing instance network info cache due to event network-changed-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-65708ae6-204b-441e-b499-1896af188ce5 req-42c23463-dff0-4d8d-9dc6-9a08358af9a8 service nova] Acquiring lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-65708ae6-204b-441e-b499-1896af188ce5 req-42c23463-dff0-4d8d-9dc6-9a08358af9a8 service nova] Acquired lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-65708ae6-204b-441e-b499-1896af188ce5 req-42c23463-dff0-4d8d-9dc6-9a08358af9a8 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing network info cache for port e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-65708ae6-204b-441e-b499-1896af188ce5 req-42c23463-dff0-4d8d-9dc6-9a08358af9a8 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-65708ae6-204b-441e-b499-1896af188ce5 req-42c23463-dff0-4d8d-9dc6-9a08358af9a8 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-65708ae6-204b-441e-b499-1896af188ce5 req-42c23463-dff0-4d8d-9dc6-9a08358af9a8 service nova] Releasing lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Successfully updated port: 6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquired lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:38:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-changed-27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing instance network info cache due to event network-changed-27a00e05-7181-4d39-92ab-121218d84e48. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] Acquiring lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [{"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Releasing lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Instance network_info: |[{"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] Acquired lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG nova.network.neutron [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing network info cache for port 27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG nova.network.neutron [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updated VIF entry in instance network info cache for port 27a00e05-7181-4d39-92ab-121218d84e48. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG nova.network.neutron [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [{"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] Releasing lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-changed-6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing instance network info cache due to event network-changed-6063758d-5a93-4b48-9d31-fad4e01a7e9c. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] Acquiring lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] Acquired lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:38 user nova-compute[73068]: DEBUG nova.network.neutron [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing network info cache for port 6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG nova.network.neutron [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updated VIF entry in instance network info cache for port 6063758d-5a93-4b48-9d31-fad4e01a7e9c. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG nova.network.neutron [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [{"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00cc7251-dbd8-46d7-82dc-a66387a96d07 req-461b8cb9-8b25-4d72-a46a-a146654ae63a service nova] Releasing lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:39 user nova-compute[73068]: INFO nova.virt.block_device [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Booting with volume 947e2435-253d-489b-9f1a-24dfd22c5cc7 at /dev/vdb
Aug 26 11:38:39 user nova-compute[73068]: DEBUG os_brick.utils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e43e20-aa61-4ba0-9c86-8634a0a0d2d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7286e2-fbc6-4d30-a6c8-6e4c0d18843c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aaa409-78bb-42f9-ba96-33e6abb1cded]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfd3882-4696-491b-a421-d22fa0e5a113]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:39 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:38:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d1b56d-7acf-4878-80dc-a532309f1edb]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG os_brick.utils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:38:39 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating existing volume attachment record: 20962994-b5b8-45ed-a343-cda921a775b2 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:38:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-2bec480b-7219-4e5e-8e6f-bb5d061b94ff req-de1069c0-a5fe-4fa5-b4eb-1cbcac1eb995 service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Received event network-changed-ee146c0d-fc52-4402-9c39-b4957128f3ef {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-2bec480b-7219-4e5e-8e6f-bb5d061b94ff req-de1069c0-a5fe-4fa5-b4eb-1cbcac1eb995 service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Refreshing instance network info cache due to event network-changed-ee146c0d-fc52-4402-9c39-b4957128f3ef. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2bec480b-7219-4e5e-8e6f-bb5d061b94ff req-de1069c0-a5fe-4fa5-b4eb-1cbcac1eb995 service nova] Acquiring lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2bec480b-7219-4e5e-8e6f-bb5d061b94ff req-de1069c0-a5fe-4fa5-b4eb-1cbcac1eb995 service nova] Acquired lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG nova.network.neutron [req-2bec480b-7219-4e5e-8e6f-bb5d061b94ff req-de1069c0-a5fe-4fa5-b4eb-1cbcac1eb995 service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Refreshing network info cache for port ee146c0d-fc52-4402-9c39-b4957128f3ef {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:42 user nova-compute[73068]: INFO nova.virt.block_device [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Booting with volume 1f899d0b-2948-4afd-a7d7-4b0166a31659 at /dev/vdc
Aug 26 11:38:42 user nova-compute[73068]: DEBUG os_brick.utils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[864fd1bd-958e-441a-ac38-5f41a7775795]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccc8e8a-5821-4002-b779-05568bf0736a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a15cbb-3556-43a9-98e1-8ddbd35fb57f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d65078a-a4d2-4384-9010-007b0f5cff7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:42 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[73909801-1822-49cc-a779-c4a6d183aa66]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG os_brick.utils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating existing volume attachment record: 517993f6-4ba1-4f4d-bef3-24cb009d77d1 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG nova.network.neutron [req-2bec480b-7219-4e5e-8e6f-bb5d061b94ff req-de1069c0-a5fe-4fa5-b4eb-1cbcac1eb995 service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Updated VIF entry in instance network info cache for port ee146c0d-fc52-4402-9c39-b4957128f3ef. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG nova.network.neutron [req-2bec480b-7219-4e5e-8e6f-bb5d061b94ff req-de1069c0-a5fe-4fa5-b4eb-1cbcac1eb995 service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Updating instance_info_cache with network_info: [{"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2bec480b-7219-4e5e-8e6f-bb5d061b94ff req-de1069c0-a5fe-4fa5-b4eb-1cbcac1eb995 service nova] Releasing lock "refresh_cache-937978de-8e83-42e7-b906-ccc226924f1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "ca81b728-2fd8-46d9-822d-2a468fd507e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:38:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:38:43 user nova-compute[73068]: INFO nova.compute.claims [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Claim successful on node user
Aug 26 11:38:43 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:38:43 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:38:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:38:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:38:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:38:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:38:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:38:44 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Creating image(s)
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "/opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "/opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG nova.policy [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '442fddac9e534bbc9d8a5966e6bc3c26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17bdd7cec1d84290be2b2a22a7834b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk 1073741824" returned: 0 in 0.059s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.202s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Successfully created port: 843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Cannot resize image /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Ensure instance console log exists: /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.network.neutron [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Successfully updated port: 843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "refresh_cache-ca81b728-2fd8-46d9-822d-2a468fd507e3" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquired lock "refresh_cache-ca81b728-2fd8-46d9-822d-2a468fd507e3" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.network.neutron [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-51700ee5-db2c-49f3-9e06-c22ef035b662 req-07df6f8b-32a0-4f37-a378-07e0eeb1c9c1 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Received event network-changed-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-51700ee5-db2c-49f3-9e06-c22ef035b662 req-07df6f8b-32a0-4f37-a378-07e0eeb1c9c1 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Refreshing instance network info cache due to event network-changed-843afae1-3465-4a0e-8b55-5a05b1b8fdf1. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-51700ee5-db2c-49f3-9e06-c22ef035b662 req-07df6f8b-32a0-4f37-a378-07e0eeb1c9c1 service nova] Acquiring lock "refresh_cache-ca81b728-2fd8-46d9-822d-2a468fd507e3" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.network.neutron [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.network.neutron [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Updating instance_info_cache with network_info: [{"id": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "address": "fa:16:3e:8d:1a:71", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843afae1-34", "ovs_interfaceid": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Releasing lock "refresh_cache-ca81b728-2fd8-46d9-822d-2a468fd507e3" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Instance network_info: |[{"id": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "address": "fa:16:3e:8d:1a:71", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843afae1-34", "ovs_interfaceid": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-51700ee5-db2c-49f3-9e06-c22ef035b662 req-07df6f8b-32a0-4f37-a378-07e0eeb1c9c1 service nova] Acquired lock "refresh_cache-ca81b728-2fd8-46d9-822d-2a468fd507e3" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.network.neutron [req-51700ee5-db2c-49f3-9e06-c22ef035b662 req-07df6f8b-32a0-4f37-a378-07e0eeb1c9c1 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Refreshing network info cache for port 843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Start _get_guest_xml network_info=[{"id": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "address": "fa:16:3e:8d:1a:71", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843afae1-34", "ovs_interfaceid": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:38:45 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:38:45 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:38:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1025715738',display_name='tempest-ServersNegativeTestJSON-server-1025715738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1025715738',id=12,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17bdd7cec1d84290be2b2a22a7834b40',ramdisk_id='',reservation_id='r-a4uq102u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-41614951',owner_user_name='tempest-ServersNegativeTestJSON-41614951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:44Z,user_data=None,user_id='442fddac9e534bbc9d8a5966e6bc3c26',uuid=ca81b728-2fd8-46d9-822d-2a468fd507e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "address": "fa:16:3e:8d:1a:71", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843afae1-34", "ovs_interfaceid": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converting VIF {"id": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "address": "fa:16:3e:8d:1a:71", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843afae1-34", "ovs_interfaceid": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:71,bridge_name='br-int',has_traffic_filtering=True,id=843afae1-3465-4a0e-8b55-5a05b1b8fdf1,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843afae1-34') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.objects.instance [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lazy-loading 'pci_devices' on Instance uuid ca81b728-2fd8-46d9-822d-2a468fd507e3 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:38:46 user nova-compute[73068]:   <uuid>ca81b728-2fd8-46d9-822d-2a468fd507e3</uuid>
Aug 26 11:38:46 user nova-compute[73068]:   <name>instance-0000000c</name>
Aug 26 11:38:46 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:38:46 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:38:46 user nova-compute[73068]:   <metadata>
Aug 26 11:38:46 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:38:46 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:38:46 user nova-compute[73068]:       <nova:name>tempest-ServersNegativeTestJSON-server-1025715738</nova:name>
Aug 26 11:38:46 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:38:45</nova:creationTime>
Aug 26 11:38:46 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:38:46 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:38:46 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:38:46 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:38:46 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:38:46 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:38:46 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:38:46 user nova-compute[73068]:       <nova:owner>
Aug 26 11:38:46 user nova-compute[73068]:         <nova:user uuid="442fddac9e534bbc9d8a5966e6bc3c26">tempest-ServersNegativeTestJSON-41614951-project-member</nova:user>
Aug 26 11:38:46 user nova-compute[73068]:         <nova:project uuid="17bdd7cec1d84290be2b2a22a7834b40">tempest-ServersNegativeTestJSON-41614951</nova:project>
Aug 26 11:38:46 user nova-compute[73068]:       </nova:owner>
Aug 26 11:38:46 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:38:46 user nova-compute[73068]:       <nova:ports>
Aug 26 11:38:46 user nova-compute[73068]:         <nova:port uuid="843afae1-3465-4a0e-8b55-5a05b1b8fdf1">
Aug 26 11:38:46 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 11:38:46 user nova-compute[73068]:         </nova:port>
Aug 26 11:38:46 user nova-compute[73068]:       </nova:ports>
Aug 26 11:38:46 user nova-compute[73068]:     </nova:instance>
Aug 26 11:38:46 user nova-compute[73068]:   </metadata>
Aug 26 11:38:46 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:38:46 user nova-compute[73068]:     <system>
Aug 26 11:38:46 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:38:46 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:38:46 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:38:46 user nova-compute[73068]:       <entry name="serial">ca81b728-2fd8-46d9-822d-2a468fd507e3</entry>
Aug 26 11:38:46 user nova-compute[73068]:       <entry name="uuid">ca81b728-2fd8-46d9-822d-2a468fd507e3</entry>
Aug 26 11:38:46 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:38:46 user nova-compute[73068]:     </system>
Aug 26 11:38:46 user nova-compute[73068]:   </sysinfo>
Aug 26 11:38:46 user nova-compute[73068]:   <os>
Aug 26 11:38:46 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:38:46 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:38:46 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:38:46 user nova-compute[73068]:   </os>
Aug 26 11:38:46 user nova-compute[73068]:   <features>
Aug 26 11:38:46 user nova-compute[73068]:     <acpi/>
Aug 26 11:38:46 user nova-compute[73068]:     <apic/>
Aug 26 11:38:46 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:38:46 user nova-compute[73068]:   </features>
Aug 26 11:38:46 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:38:46 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:38:46 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:38:46 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:38:46 user nova-compute[73068]:   </clock>
Aug 26 11:38:46 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:38:46 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:38:46 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:38:46 user nova-compute[73068]:   </cpu>
Aug 26 11:38:46 user nova-compute[73068]:   <devices>
Aug 26 11:38:46 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:38:46 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:38:46 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk"/>
Aug 26 11:38:46 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:38:46 user nova-compute[73068]:     </disk>
Aug 26 11:38:46 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:38:46 user nova-compute[73068]:       <mac address="fa:16:3e:8d:1a:71"/>
Aug 26 11:38:46 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:38:46 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:38:46 user nova-compute[73068]:       <target dev="tap843afae1-34"/>
Aug 26 11:38:46 user nova-compute[73068]:     </interface>
Aug 26 11:38:46 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:38:46 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/console.log" append="off"/>
Aug 26 11:38:46 user nova-compute[73068]:     </serial>
Aug 26 11:38:46 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:38:46 user nova-compute[73068]:     <video>
Aug 26 11:38:46 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:38:46 user nova-compute[73068]:     </video>
Aug 26 11:38:46 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:38:46 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:38:46 user nova-compute[73068]:     </rng>
Aug 26 11:38:46 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:38:46 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:38:46 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:38:46 user nova-compute[73068]:     </memballoon>
Aug 26 11:38:46 user nova-compute[73068]:   </devices>
Aug 26 11:38:46 user nova-compute[73068]: </domain>
Aug 26 11:38:46 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1025715738',display_name='tempest-ServersNegativeTestJSON-server-1025715738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1025715738',id=12,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17bdd7cec1d84290be2b2a22a7834b40',ramdisk_id='',reservation_id='r-a4uq102u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-41614951',owner_user_name='tempest-ServersNegativeTestJSON-41614951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:44Z,user_data=None,user_id='442fddac9e534bbc9d8a5966e6bc3c26',uuid=ca81b728-2fd8-46d9-822d-2a468fd507e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "address": "fa:16:3e:8d:1a:71", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843afae1-34", "ovs_interfaceid": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converting VIF {"id": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "address": "fa:16:3e:8d:1a:71", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843afae1-34", "ovs_interfaceid": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:71,bridge_name='br-int',has_traffic_filtering=True,id=843afae1-3465-4a0e-8b55-5a05b1b8fdf1,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843afae1-34') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG os_vif [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:71,bridge_name='br-int',has_traffic_filtering=True,id=843afae1-3465-4a0e-8b55-5a05b1b8fdf1,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843afae1-34') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap843afae1-34, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap843afae1-34, col_values=(('external_ids', {'iface-id': '843afae1-3465-4a0e-8b55-5a05b1b8fdf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:1a:71', 'vm-uuid': 'ca81b728-2fd8-46d9-822d-2a468fd507e3'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:46 user nova-compute[73068]: INFO os_vif [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:71,bridge_name='br-int',has_traffic_filtering=True,id=843afae1-3465-4a0e-8b55-5a05b1b8fdf1,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843afae1-34')
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] No VIF found with MAC fa:16:3e:8d:1a:71, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Updating instance_info_cache with network_info: [{"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.network.neutron [req-51700ee5-db2c-49f3-9e06-c22ef035b662 req-07df6f8b-32a0-4f37-a378-07e0eeb1c9c1 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Updated VIF entry in instance network info cache for port 843afae1-3465-4a0e-8b55-5a05b1b8fdf1. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG nova.network.neutron [req-51700ee5-db2c-49f3-9e06-c22ef035b662 req-07df6f8b-32a0-4f37-a378-07e0eeb1c9c1 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Updating instance_info_cache with network_info: [{"id": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "address": "fa:16:3e:8d:1a:71", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843afae1-34", "ovs_interfaceid": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-51700ee5-db2c-49f3-9e06-c22ef035b662 req-07df6f8b-32a0-4f37-a378-07e0eeb1c9c1 service nova] Releasing lock "refresh_cache-ca81b728-2fd8-46d9-822d-2a468fd507e3" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "937978de-8e83-42e7-b906-ccc226924f1f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG nova.objects.instance [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'flavor' on Instance uuid 937978de-8e83-42e7-b906-ccc226924f1f {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "937978de-8e83-42e7-b906-ccc226924f1f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:47 user nova-compute[73068]: INFO nova.compute.manager [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Attaching volume 164b8e0c-a789-4590-8b65-04a1c7878965 to /dev/vdb
Aug 26 11:38:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG os_brick.utils [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd49d43-6a4e-41ab-b64d-56d96916ead6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-b206a6d1-898b-4c15-b9c2-d58fdc18a1e9 req-eb7b1474-1b31-48e0-9776-9ef167ffd6c7 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Received event network-vif-plugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b206a6d1-898b-4c15-b9c2-d58fdc18a1e9 req-eb7b1474-1b31-48e0-9776-9ef167ffd6c7 service nova] Acquiring lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b206a6d1-898b-4c15-b9c2-d58fdc18a1e9 req-eb7b1474-1b31-48e0-9776-9ef167ffd6c7 service nova] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b206a6d1-898b-4c15-b9c2-d58fdc18a1e9 req-eb7b1474-1b31-48e0-9776-9ef167ffd6c7 service nova] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-b206a6d1-898b-4c15-b9c2-d58fdc18a1e9 req-eb7b1474-1b31-48e0-9776-9ef167ffd6c7 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] No waiting events found dispatching network-vif-plugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:38:47 user nova-compute[73068]: WARNING nova.compute.manager [req-b206a6d1-898b-4c15-b9c2-d58fdc18a1e9 req-eb7b1474-1b31-48e0-9776-9ef167ffd6c7 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Received unexpected event network-vif-plugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 for instance with vm_state building and task_state spawning.
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c02d8-45cb-4127-a69a-73b1c4c32ca3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b503ec0-fb87-4da5-95b3-89576f0f19c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1a8324-ba7a-4ca8-a309-717ddc90fb53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:47 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:48 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d266c69-717b-4da7-9956-a35c3bb1c7e4]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG os_brick.utils [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Updating existing volume attachment record: 676e50f8-72d8-4c20-af76-5ca557508afe {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-b376760f-9043-4fcc-952b-cba203328ee5 req-ec83230c-be74-47bf-ae45-7a295e1666e6 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-changed-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-b376760f-9043-4fcc-952b-cba203328ee5 req-ec83230c-be74-47bf-ae45-7a295e1666e6 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Refreshing instance network info cache due to event network-changed-633ed4fe-2630-42c2-b0ff-dba262056dad. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b376760f-9043-4fcc-952b-cba203328ee5 req-ec83230c-be74-47bf-ae45-7a295e1666e6 service nova] Acquiring lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b376760f-9043-4fcc-952b-cba203328ee5 req-ec83230c-be74-47bf-ae45-7a295e1666e6 service nova] Acquired lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG nova.network.neutron [req-b376760f-9043-4fcc-952b-cba203328ee5 req-ec83230c-be74-47bf-ae45-7a295e1666e6 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Refreshing network info cache for port 633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG nova.network.neutron [req-b376760f-9043-4fcc-952b-cba203328ee5 req-ec83230c-be74-47bf-ae45-7a295e1666e6 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updated VIF entry in instance network info cache for port 633ed4fe-2630-42c2-b0ff-dba262056dad. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG nova.network.neutron [req-b376760f-9043-4fcc-952b-cba203328ee5 req-ec83230c-be74-47bf-ae45-7a295e1666e6 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating instance_info_cache with network_info: [{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b376760f-9043-4fcc-952b-cba203328ee5 req-ec83230c-be74-47bf-ae45-7a295e1666e6 service nova] Releasing lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:38:49 user nova-compute[73068]: INFO nova.compute.manager [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] instance snapshotting
Aug 26 11:38:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:49 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Beginning live snapshot process
Aug 26 11:38:49 user nova-compute[73068]: DEBUG nova.compute.manager [req-4c4d3309-c9ce-46ba-a961-66c86544f96a req-59e9dcb3-cc0e-44f4-bc57-cd9e60af1d7e service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Received event network-vif-plugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:38:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4c4d3309-c9ce-46ba-a961-66c86544f96a req-59e9dcb3-cc0e-44f4-bc57-cd9e60af1d7e service nova] Acquiring lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4c4d3309-c9ce-46ba-a961-66c86544f96a req-59e9dcb3-cc0e-44f4-bc57-cd9e60af1d7e service nova] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4c4d3309-c9ce-46ba-a961-66c86544f96a req-59e9dcb3-cc0e-44f4-bc57-cd9e60af1d7e service nova] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.compute.manager [req-4c4d3309-c9ce-46ba-a961-66c86544f96a req-59e9dcb3-cc0e-44f4-bc57-cd9e60af1d7e service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] No waiting events found dispatching network-vif-plugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:38:50 user nova-compute[73068]: WARNING nova.compute.manager [req-4c4d3309-c9ce-46ba-a961-66c86544f96a req-59e9dcb3-cc0e-44f4-bc57-cd9e60af1d7e service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Received unexpected event network-vif-plugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 for instance with vm_state building and task_state spawning.
Aug 26 11:38:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049930.0315123, ca81b728-2fd8-46d9-822d-2a468fd507e3 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:38:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] VM Resumed (Lifecycle Event)
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:38:50 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Instance spawned successfully.
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:38:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049930.0325394, ca81b728-2fd8-46d9-822d-2a468fd507e3 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:38:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] VM Started (Lifecycle Event)
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:38:50 user nova-compute[73068]: INFO nova.compute.manager [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 26 11:38:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json -f qcow2 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:50 user nova-compute[73068]: INFO nova.compute.manager [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Took 7.10 seconds to build instance.
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ce80d92-3bea-4da2-8651-9221263c3ded tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.247s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json -f qcow2 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json -f qcow2" returned: 0 in 0.246s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.244s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy0q0cg0x/f6157922ce07490cbe70e9f90d10a8ad.delta 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy0q0cg0x/f6157922ce07490cbe70e9f90d10a8ad.delta 1073741824" returned: 0 in 0.091s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:51 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 11:38:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73068) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 26 11:38:51 user nova-compute[73068]: INFO nova.virt.libvirt.host [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] UEFI support detected
Aug 26 11:38:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] COPY block job progress, current cursor: 983040 final cursor: 75497472 {{(pid=73068) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 11:38:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73068) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 11:38:52 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 11:38:52 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:38:52 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:38:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7021MB free_disk=25.729717254638672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:38:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy0q0cg0x/f6157922ce07490cbe70e9f90d10a8ad.delta /opt/stack/data/nova/instances/snapshots/tmpy0q0cg0x/f6157922ce07490cbe70e9f90d10a8ad {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:53 user nova-compute[73068]: INFO nova.virt.block_device [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Booting with volume b24e73d0-63fc-4066-9ebc-d70188fcea5b at /dev/vdc
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 937978de-8e83-42e7-b906-ccc226924f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance fba812b3-7791-463f-9c86-a51ae7a7457d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 85b6aa5b-72c1-415f-8552-19d0cd3859d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3c888403-0a31-4494-b822-73f42acadf00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 792b5efb-63fa-4e87-b114-61de6180b2c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 63ea93a3-9a33-42fd-af3a-686b848d0dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 23af7614-b27e-4e97-8180-5289cf8d9bcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ca81b728-2fd8-46d9-822d-2a468fd507e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG os_brick.utils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a3b5cf-cae0-4217-b71f-445557532bf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.035s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d05504-b5c6-4ee0-8eca-cef807c0cb43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[677a1f8c-a6f3-4816-bc1d-59c8e7566cd4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[539cad70-8879-4a01-bb2a-2385da20e2a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:38:53 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa09350-a743-49e5-b8c7-1cd39fd391a1]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG os_brick.utils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating existing volume attachment record: d67b9b50-fbb6-48c4-80e1-7d6adfb0913f {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy0q0cg0x/f6157922ce07490cbe70e9f90d10a8ad.delta /opt/stack/data/nova/instances/snapshots/tmpy0q0cg0x/f6157922ce07490cbe70e9f90d10a8ad" returned: 0 in 0.745s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:53 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Snapshot extracted, beginning image upload
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:38:53 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:38:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:38:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.069s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:38:57 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Snapshot image upload complete
Aug 26 11:38:57 user nova-compute[73068]: INFO nova.compute.manager [None req-60b6ccda-440b-4e51-a942-36edeb066164 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Took 7.48 seconds to snapshot the instance on the hypervisor.
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:38:57 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Creating image(s)
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Ensure instance console log exists: /opt/stack/data/nova/instances/8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Start _get_guest_xml network_info=[{"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'a49af3d0-f2dc-40cf-a3b3-6f26fb753999', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYyVzbpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8', 'attached_at': '', 'detached_at': '', 'volume_id': '4cd96df1-c124-47d4-a50f-24916b465e63', 'serial': '4cd96df1-c124-47d4-a50f-24916b465e63'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '5d5b22d1-edb3-4ee1-81f5-33ac77f1cf50', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIDQWyOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f1da6ab8-9518-4dfa-be22-538d76200b8d', 'serial': 'f1da6ab8-9518-4dfa-be22-538d76200b8d'}, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '517993f6-4ba1-4f4d-bef3-24cb009d77d1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USaiJjrM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8', 'attached_at': '', 'detached_at': '', 'volume_id': '1f899d0b-2948-4afd-a7d7-4b0166a31659', 'serial': '1f899d0b-2948-4afd-a7d7-4b0166a31659'}, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:38:57 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:38:57 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYyVzbpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:38:57 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:38:57 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:38:57 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fe5702-bd22-4a92-83c2-e2bb0e11e383]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:38:57 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c00aa0a-1ca7-43fe-bb9d-835fe17ec749]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63] added
Aug 26 11:38:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9130c8f-caf5-4427-97f0-f109dc06cad7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[205a45b1-c977-4788-aac2-271463fde23d]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYyVzbpT {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYyVzbpT" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c14fb1e-0a4e-402e-a95c-7b06ed2bce68]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aYyVzbpT'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5010982-d0da-4c32-8de4-1868c781dab8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dbcaf9-4f79-45d4-8298-41c7854d49f0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:38:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:38:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1942148a-304a-4939-a032-9969474deac2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63, portal: 172.16.0.220,3260]
Aug 26 11:38:57 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63, portal: 172.16.0.220,3260] successful.
Aug 26 11:38:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a23b57-5803-4c0b-87b5-27e59c87d94c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bad76e0-70a8-4b4e-9764-54c892cd673d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:38:57 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:38:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:38:57 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:38:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd86aa-4c3b-43f3-9813-739e92ff5f84]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:38:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYyVzbpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26535393937643739', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535393937643739', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIDQWyOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:38:58 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:38:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:38:58 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:38:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:38:58 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:38:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4964844d-4738-445f-80a3-bb926fc855fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:38:58 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e9e71d-f027-43b2-bca9-59f8865fae1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d] added
Aug 26 11:38:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[434ba51b-d83a-4a72-b299-7b53b51c1131]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c5b5ce-21d2-40a1-846f-16e48eb3f924]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIDQWyOG {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIDQWyOG" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e95fea-4d7c-4e8d-b909-5064f7f89c41]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dIDQWyOG'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ab97d8-6a1c-4bcc-8709-9cec5ddb3273]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a446f8f8-7228-4b5c-a93a-ca2914e26c4f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:38:59 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:38:59 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:38:59 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:38:59 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff6d9fb-5f6f-43f7-b73a-49d0a55089de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d, portal: 172.16.0.220,3260]
Aug 26 11:38:59 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d, portal: 172.16.0.220,3260] successful.
Aug 26 11:38:59 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[910aa692-c0f3-4510-a16b-61cb65a2458c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2915c953-ca1e-49f9-98cd-577b24705c2a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:38:59 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:38:59 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:38:59 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:38:59 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:38:59 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:38:59 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c3d866-268d-4855-9645-edc28e1e72b0]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:38:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIDQWyOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26262356661333763', 'path': '/dev/sdd'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262356661333763', 'path': '/dev/sdd'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USaiJjrM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:00 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:00 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:00 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[da35f106-6656-4de4-87b2-1fe8bdba90c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:39:00 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a2b26c-af9a-434d-996b-eb9d0a58fb46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659] added
Aug 26 11:39:00 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[674dcba8-b034-4da2-96b5-0e9b953aeed4]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5bea07-c6b6-4dbb-adaf-02c74d33492c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USaiJjrM {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USaiJjrM" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ea0ee7-15ac-417f-bfad-488faa7675ba]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'USaiJjrM'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[de758a0a-0ffb-4a8d-808a-a9acac37ecb9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee024c4e-b3ca-4982-930f-c10ac1300621]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:00 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:00 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:00 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:00 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:00 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:00 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83fffea-c414-4119-b773-de9d86bf37b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659, portal: 172.16.0.220,3260]
Aug 26 11:39:00 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:00 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f121399-2151-4f99-a161-f9c0f8f75f3c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[be121c78-2623-42b7-8969-792b4ffafb53]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:00 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:00 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:00 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:00 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:00 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:00 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:00 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:00 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[405519a7-88e8-4e61-a875-fbcc58b60d71]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:39:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USaiJjrM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23830313637366664', 'path': '/dev/sde'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830313637366664', 'path': '/dev/sde'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:09:4e,bridge_name='br-int',has_traffic_filtering=True,id=0627ade3-5789-4bab-8e59-684ca2e6b871,network=Network(81cd492b-d44a-49d5-a375-15ca08c663e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0627ade3-57') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:d3:75,bridge_name='br-int',has_traffic_filtering=True,id=542f57ca-0e66-4492-a4d5-1fbbd78d5a3d,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap542f57ca-0e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:c2:07,bridge_name='br-int',has_traffic_filtering=True,id=4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a1c39f9-cc') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=23a55e92-430b-4393-8957-cfc9dce489be,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a55e92-43') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d6:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b676f78-696f-4ef3-8529-a3892bf0aeb1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b676f78-69') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d2:2c,bridge_name='br-int',has_traffic_filtering=True,id=c1f2ea89-5b9c-46ba-a9a9-16e75263b153,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f2ea89-5b') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:14:90,bridge_name='br-int',has_traffic_filtering=True,id=9106173f-4454-446d-a434-3222ed390edf,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9106173f-44') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.objects.instance [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:39:01 user nova-compute[73068]:   <uuid>8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8</uuid>
Aug 26 11:39:01 user nova-compute[73068]:   <name>instance-0000000a</name>
Aug 26 11:39:01 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:39:01 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:39:01 user nova-compute[73068]:   <metadata>
Aug 26 11:39:01 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:39:01 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:39:01 user nova-compute[73068]:       <nova:name>tempest-device-tagging-server-480879360</nova:name>
Aug 26 11:39:01 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:38:57</nova:creationTime>
Aug 26 11:39:01 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:39:01 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:39:01 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:39:01 user nova-compute[73068]:       <nova:owner>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:user uuid="38f47dcfe8a74fe1a7138cb072f4dc3c">tempest-TaggedBootDevicesTest-1872630429-project-member</nova:user>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:project uuid="39175659a66542958d7d93274ee45cde">tempest-TaggedBootDevicesTest-1872630429</nova:project>
Aug 26 11:39:01 user nova-compute[73068]:       </nova:owner>
Aug 26 11:39:01 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:39:01 user nova-compute[73068]:       <nova:ports>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:port uuid="0627ade3-5789-4bab-8e59-684ca2e6b871">
Aug 26 11:39:01 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 11:39:01 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:port uuid="542f57ca-0e66-4492-a4d5-1fbbd78d5a3d">
Aug 26 11:39:01 user nova-compute[73068]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
Aug 26 11:39:01 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:port uuid="4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1">
Aug 26 11:39:01 user nova-compute[73068]:           <nova:ip type="fixed" address="10.1.1.28" ipVersion="4"/>
Aug 26 11:39:01 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:port uuid="23a55e92-430b-4393-8957-cfc9dce489be">
Aug 26 11:39:01 user nova-compute[73068]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
Aug 26 11:39:01 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:port uuid="3b676f78-696f-4ef3-8529-a3892bf0aeb1">
Aug 26 11:39:01 user nova-compute[73068]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Aug 26 11:39:01 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:port uuid="c1f2ea89-5b9c-46ba-a9a9-16e75263b153">
Aug 26 11:39:01 user nova-compute[73068]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 11:39:01 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:01 user nova-compute[73068]:         <nova:port uuid="9106173f-4454-446d-a434-3222ed390edf">
Aug 26 11:39:01 user nova-compute[73068]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 11:39:01 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:01 user nova-compute[73068]:       </nova:ports>
Aug 26 11:39:01 user nova-compute[73068]:     </nova:instance>
Aug 26 11:39:01 user nova-compute[73068]:   </metadata>
Aug 26 11:39:01 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:39:01 user nova-compute[73068]:     <system>
Aug 26 11:39:01 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:39:01 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:39:01 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:39:01 user nova-compute[73068]:       <entry name="serial">8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8</entry>
Aug 26 11:39:01 user nova-compute[73068]:       <entry name="uuid">8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8</entry>
Aug 26 11:39:01 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:39:01 user nova-compute[73068]:     </system>
Aug 26 11:39:01 user nova-compute[73068]:   </sysinfo>
Aug 26 11:39:01 user nova-compute[73068]:   <os>
Aug 26 11:39:01 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:39:01 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:39:01 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:39:01 user nova-compute[73068]:   </os>
Aug 26 11:39:01 user nova-compute[73068]:   <features>
Aug 26 11:39:01 user nova-compute[73068]:     <acpi/>
Aug 26 11:39:01 user nova-compute[73068]:     <apic/>
Aug 26 11:39:01 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:39:01 user nova-compute[73068]:   </features>
Aug 26 11:39:01 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:39:01 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:39:01 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:39:01 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:39:01 user nova-compute[73068]:   </clock>
Aug 26 11:39:01 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:39:01 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:39:01 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:39:01 user nova-compute[73068]:   </cpu>
Aug 26 11:39:01 user nova-compute[73068]:   <devices>
Aug 26 11:39:01 user nova-compute[73068]:     <disk type="file" device="cdrom">
Aug 26 11:39:01 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 11:39:01 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8/disk.config"/>
Aug 26 11:39:01 user nova-compute[73068]:       <target dev="hda" bus="ide"/>
Aug 26 11:39:01 user nova-compute[73068]:     </disk>
Aug 26 11:39:01 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:39:01 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:01 user nova-compute[73068]:       <source dev="/dev/sdc"/>
Aug 26 11:39:01 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:39:01 user nova-compute[73068]:       <serial>4cd96df1-c124-47d4-a50f-24916b465e63</serial>
Aug 26 11:39:01 user nova-compute[73068]:     </disk>
Aug 26 11:39:01 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:39:01 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:01 user nova-compute[73068]:       <source dev="/dev/sdd"/>
Aug 26 11:39:01 user nova-compute[73068]:       <target dev="vdb" bus="virtio"/>
Aug 26 11:39:01 user nova-compute[73068]:       <serial>f1da6ab8-9518-4dfa-be22-538d76200b8d</serial>
Aug 26 11:39:01 user nova-compute[73068]:     </disk>
Aug 26 11:39:01 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:39:01 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:01 user nova-compute[73068]:       <source dev="/dev/sde"/>
Aug 26 11:39:01 user nova-compute[73068]:       <target dev="vdc" bus="virtio"/>
Aug 26 11:39:01 user nova-compute[73068]:       <serial>1f899d0b-2948-4afd-a7d7-4b0166a31659</serial>
Aug 26 11:39:01 user nova-compute[73068]:     </disk>
Aug 26 11:39:01 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:01 user nova-compute[73068]:       <mac address="fa:16:3e:74:09:4e"/>
Aug 26 11:39:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:01 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:01 user nova-compute[73068]:       <target dev="tap0627ade3-57"/>
Aug 26 11:39:01 user nova-compute[73068]:     </interface>
Aug 26 11:39:01 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:01 user nova-compute[73068]:       <mac address="fa:16:3e:05:d3:75"/>
Aug 26 11:39:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:01 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:01 user nova-compute[73068]:       <target dev="tap542f57ca-0e"/>
Aug 26 11:39:01 user nova-compute[73068]:     </interface>
Aug 26 11:39:01 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:01 user nova-compute[73068]:       <mac address="fa:16:3e:da:c2:07"/>
Aug 26 11:39:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:01 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:01 user nova-compute[73068]:       <target dev="tap4a1c39f9-cc"/>
Aug 26 11:39:01 user nova-compute[73068]:     </interface>
Aug 26 11:39:01 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:01 user nova-compute[73068]:       <mac address="fa:16:3e:df:17:ac"/>
Aug 26 11:39:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:01 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:01 user nova-compute[73068]:       <target dev="tap23a55e92-43"/>
Aug 26 11:39:01 user nova-compute[73068]:     </interface>
Aug 26 11:39:01 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:01 user nova-compute[73068]:       <mac address="fa:16:3e:1d:d6:e1"/>
Aug 26 11:39:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:01 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:01 user nova-compute[73068]:       <target dev="tap3b676f78-69"/>
Aug 26 11:39:01 user nova-compute[73068]:     </interface>
Aug 26 11:39:01 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:01 user nova-compute[73068]:       <mac address="fa:16:3e:b9:d2:2c"/>
Aug 26 11:39:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:01 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:01 user nova-compute[73068]:       <target dev="tapc1f2ea89-5b"/>
Aug 26 11:39:01 user nova-compute[73068]:     </interface>
Aug 26 11:39:01 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:01 user nova-compute[73068]:       <mac address="fa:16:3e:4a:14:90"/>
Aug 26 11:39:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:01 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:01 user nova-compute[73068]:       <target dev="tap9106173f-44"/>
Aug 26 11:39:01 user nova-compute[73068]:     </interface>
Aug 26 11:39:01 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:39:01 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8/console.log" append="off"/>
Aug 26 11:39:01 user nova-compute[73068]:     </serial>
Aug 26 11:39:01 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:39:01 user nova-compute[73068]:     <video>
Aug 26 11:39:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:01 user nova-compute[73068]:     </video>
Aug 26 11:39:01 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:39:01 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:39:01 user nova-compute[73068]:     </rng>
Aug 26 11:39:01 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:39:01 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:39:01 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:39:01 user nova-compute[73068]:     </memballoon>
Aug 26 11:39:01 user nova-compute[73068]:   </devices>
Aug 26 11:39:01 user nova-compute[73068]: </domain>
Aug 26 11:39:01 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:09:4e,bridge_name='br-int',has_traffic_filtering=True,id=0627ade3-5789-4bab-8e59-684ca2e6b871,network=Network(81cd492b-d44a-49d5-a375-15ca08c663e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0627ade3-57') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:09:4e,bridge_name='br-int',has_traffic_filtering=True,id=0627ade3-5789-4bab-8e59-684ca2e6b871,network=Network(81cd492b-d44a-49d5-a375-15ca08c663e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0627ade3-57') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0627ade3-57, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0627ade3-57, col_values=(('external_ids', {'iface-id': '0627ade3-5789-4bab-8e59-684ca2e6b871', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:09:4e', 'vm-uuid': '8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: INFO os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:09:4e,bridge_name='br-int',has_traffic_filtering=True,id=0627ade3-5789-4bab-8e59-684ca2e6b871,network=Network(81cd492b-d44a-49d5-a375-15ca08c663e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0627ade3-57')
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:d3:75,bridge_name='br-int',has_traffic_filtering=True,id=542f57ca-0e66-4492-a4d5-1fbbd78d5a3d,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap542f57ca-0e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d3:75,bridge_name='br-int',has_traffic_filtering=True,id=542f57ca-0e66-4492-a4d5-1fbbd78d5a3d,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap542f57ca-0e') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap542f57ca-0e, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap542f57ca-0e, col_values=(('external_ids', {'iface-id': '542f57ca-0e66-4492-a4d5-1fbbd78d5a3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:d3:75', 'vm-uuid': '8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MzipRWCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:01 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:01 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:01 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: INFO os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d3:75,bridge_name='br-int',has_traffic_filtering=True,id=542f57ca-0e66-4492-a4d5-1fbbd78d5a3d,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap542f57ca-0e')
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:c2:07,bridge_name='br-int',has_traffic_filtering=True,id=4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a1c39f9-cc') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:c2:07,bridge_name='br-int',has_traffic_filtering=True,id=4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a1c39f9-cc') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a1c39f9-cc, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a1c39f9-cc, col_values=(('external_ids', {'iface-id': '4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:c2:07', 'vm-uuid': '8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2df123-a1d3-4ffd-8db3-fff01c08b39d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:39:01 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b04ecd-4c4e-46cd-8953-07ae2b238968]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965] added
Aug 26 11:39:02 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: INFO os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:c2:07,bridge_name='br-int',has_traffic_filtering=True,id=4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a1c39f9-cc')
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=23a55e92-430b-4393-8957-cfc9dce489be,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a55e92-43') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=23a55e92-430b-4393-8957-cfc9dce489be,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a55e92-43') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23a55e92-43, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23a55e92-43, col_values=(('external_ids', {'iface-id': '23a55e92-430b-4393-8957-cfc9dce489be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:17:ac', 'vm-uuid': '8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d22d24-97c3-4fa9-be77-9e94fab6f47b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c562bfdc-f2d8-45f6-8a1f-9ae755f75f0e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MzipRWCB {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: INFO os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=23a55e92-430b-4393-8957-cfc9dce489be,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a55e92-43')
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d6:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b676f78-696f-4ef3-8529-a3892bf0aeb1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b676f78-69') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d6:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b676f78-696f-4ef3-8529-a3892bf0aeb1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b676f78-69') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MzipRWCB" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbeabfa-7d68-4e3d-9bdd-ec6f66520725]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MzipRWCB'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b676f78-69, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b676f78-69, col_values=(('external_ids', {'iface-id': '3b676f78-696f-4ef3-8529-a3892bf0aeb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:d6:e1', 'vm-uuid': '8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c634fce1-483e-45a3-9239-7f27f5dbc812]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06b809e-198e-47d5-8138-d0512ea08d72]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: INFO os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d6:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b676f78-696f-4ef3-8529-a3892bf0aeb1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b676f78-69')
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d2:2c,bridge_name='br-int',has_traffic_filtering=True,id=c1f2ea89-5b9c-46ba-a9a9-16e75263b153,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f2ea89-5b') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d2:2c,bridge_name='br-int',has_traffic_filtering=True,id=c1f2ea89-5b9c-46ba-a9a9-16e75263b153,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f2ea89-5b') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1f2ea89-5b, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1f2ea89-5b, col_values=(('external_ids', {'iface-id': 'c1f2ea89-5b9c-46ba-a9a9-16e75263b153', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:d2:2c', 'vm-uuid': '8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5484acc2-45c1-4d2d-8ddb-44bc1b2457b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965, portal: 172.16.0.220,3260]
Aug 26 11:39:02 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:02 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: INFO os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d2:2c,bridge_name='br-int',has_traffic_filtering=True,id=c1f2ea89-5b9c-46ba-a9a9-16e75263b153,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f2ea89-5b')
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:14:90,bridge_name='br-int',has_traffic_filtering=True,id=9106173f-4454-446d-a434-3222ed390edf,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9106173f-44') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:14:90,bridge_name='br-int',has_traffic_filtering=True,id=9106173f-4454-446d-a434-3222ed390edf,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9106173f-44') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4792f9f5-13ad-4011-915c-a60a46fc3c00]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9106173f-44, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9106173f-44, col_values=(('external_ids', {'iface-id': '9106173f-4454-446d-a434-3222ed390edf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:14:90', 'vm-uuid': '8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a188f7-9378-46a8-900c-de49fa7954a4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:02 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a858b7-7750-4fb5-9763-228c1951ea82]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MzipRWCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:02 user nova-compute[73068]: INFO os_vif [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:14:90,bridge_name='br-int',has_traffic_filtering=True,id=9106173f-4454-446d-a434-3222ed390edf,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9106173f-44')
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] No BDM found with device name hda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] No VIF found with MAC fa:16:3e:74:09:4e, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] No VIF found with MAC fa:16:3e:1d:d6:e1, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:39:02 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Using config drive
Aug 26 11:39:02 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Creating config drive at /opt/stack/data/nova/instances/8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8/disk.config
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa8sjh25h {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa8sjh25h" returned: 0 in 0.061s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26166326136313962', 'path': '/dev/sdf'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166326136313962', 'path': '/dev/sdf'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:39:03 user nova-compute[73068]: DEBUG nova.objects.instance [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'flavor' on Instance uuid 937978de-8e83-42e7-b906-ccc226924f1f {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:39:03 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:03 user nova-compute[73068]:   <source dev="/dev/sdf"/>
Aug 26 11:39:03 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:39:03 user nova-compute[73068]:   <serial>164b8e0c-a789-4590-8b65-04a1c7878965</serial>
Aug 26 11:39:03 user nova-compute[73068]: </disk>
Aug 26 11:39:03 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No VIF found with MAC fa:16:3e:f4:ed:38, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-736de9d4-51f7-4612-b79e-1dc9fcbfe80c tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.657s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG nova.compute.manager [req-0bab317f-e8e6-4a33-bd05-af2435094dc5 req-0b74ee48-0d17-45a7-a4cc-ab238c136f2e service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Received event network-changed-b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG nova.compute.manager [req-0bab317f-e8e6-4a33-bd05-af2435094dc5 req-0b74ee48-0d17-45a7-a4cc-ab238c136f2e service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Refreshing instance network info cache due to event network-changed-b2bf177e-b82e-48bd-9f92-9084b2339918. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0bab317f-e8e6-4a33-bd05-af2435094dc5 req-0b74ee48-0d17-45a7-a4cc-ab238c136f2e service nova] Acquiring lock "refresh_cache-85b6aa5b-72c1-415f-8552-19d0cd3859d6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0bab317f-e8e6-4a33-bd05-af2435094dc5 req-0b74ee48-0d17-45a7-a4cc-ab238c136f2e service nova] Acquired lock "refresh_cache-85b6aa5b-72c1-415f-8552-19d0cd3859d6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG nova.network.neutron [req-0bab317f-e8e6-4a33-bd05-af2435094dc5 req-0b74ee48-0d17-45a7-a4cc-ab238c136f2e service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Refreshing network info cache for port b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.network.neutron [req-0bab317f-e8e6-4a33-bd05-af2435094dc5 req-0b74ee48-0d17-45a7-a4cc-ab238c136f2e service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Updated VIF entry in instance network info cache for port b2bf177e-b82e-48bd-9f92-9084b2339918. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.network.neutron [req-0bab317f-e8e6-4a33-bd05-af2435094dc5 req-0b74ee48-0d17-45a7-a4cc-ab238c136f2e service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Updating instance_info_cache with network_info: [{"id": "b2bf177e-b82e-48bd-9f92-9084b2339918", "address": "fa:16:3e:2d:f2:7b", "network": {"id": "2bb55e61-9a1b-424a-950c-ef73a9e48345", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772847370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0444942992475b91cb620febed557a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bf177e-b8", "ovs_interfaceid": "b2bf177e-b82e-48bd-9f92-9084b2339918", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0bab317f-e8e6-4a33-bd05-af2435094dc5 req-0b74ee48-0d17-45a7-a4cc-ab238c136f2e service nova] Releasing lock "refresh_cache-85b6aa5b-72c1-415f-8552-19d0cd3859d6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ce61b0c-df4b-4e42-87bb-f81908d64c27 req-f909cdb4-4347-4404-a02f-d34e254752d3 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ce61b0c-df4b-4e42-87bb-f81908d64c27 req-f909cdb4-4347-4404-a02f-d34e254752d3 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ce61b0c-df4b-4e42-87bb-f81908d64c27 req-f909cdb4-4347-4404-a02f-d34e254752d3 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ce61b0c-df4b-4e42-87bb-f81908d64c27 req-f909cdb4-4347-4404-a02f-d34e254752d3 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ce61b0c-df4b-4e42-87bb-f81908d64c27 req-f909cdb4-4347-4404-a02f-d34e254752d3 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:06 user nova-compute[73068]: WARNING nova.compute.manager [req-8ce61b0c-df4b-4e42-87bb-f81908d64c27 req-f909cdb4-4347-4404-a02f-d34e254752d3 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 for instance with vm_state building and task_state spawning.
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:06 user nova-compute[73068]: WARNING nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-0627ade3-5789-4bab-8e59-684ca2e6b871 for instance with vm_state building and task_state spawning.
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:06 user nova-compute[73068]: WARNING nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-0627ade3-5789-4bab-8e59-684ca2e6b871 for instance with vm_state building and task_state spawning.
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-542f57ca-0e66-4492-a4d5-1fbbd78d5a3d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-542f57ca-0e66-4492-a4d5-1fbbd78d5a3d {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:06 user nova-compute[73068]: WARNING nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-542f57ca-0e66-4492-a4d5-1fbbd78d5a3d for instance with vm_state building and task_state spawning.
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-542f57ca-0e66-4492-a4d5-1fbbd78d5a3d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-542f57ca-0e66-4492-a4d5-1fbbd78d5a3d {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:06 user nova-compute[73068]: WARNING nova.compute.manager [req-8ae1cf36-b322-48ca-8c8d-b4d5c2825f73 req-7e06d3e7-9355-4839-806d-73bb53d3f300 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-542f57ca-0e66-4492-a4d5-1fbbd78d5a3d for instance with vm_state building and task_state spawning.
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-2ba7b857-094f-400b-948b-8fb52896be8d req-f7f054a9-6a96-4398-b177-edbfb8d46433 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2ba7b857-094f-400b-948b-8fb52896be8d req-f7f054a9-6a96-4398-b177-edbfb8d46433 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2ba7b857-094f-400b-948b-8fb52896be8d req-f7f054a9-6a96-4398-b177-edbfb8d46433 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2ba7b857-094f-400b-948b-8fb52896be8d req-f7f054a9-6a96-4398-b177-edbfb8d46433 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-2ba7b857-094f-400b-948b-8fb52896be8d req-f7f054a9-6a96-4398-b177-edbfb8d46433 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:07 user nova-compute[73068]: WARNING nova.compute.manager [req-2ba7b857-094f-400b-948b-8fb52896be8d req-f7f054a9-6a96-4398-b177-edbfb8d46433 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 for instance with vm_state building and task_state spawning.
Aug 26 11:39:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:39:08 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Creating image(s)
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Ensure instance console log exists: /opt/stack/data/nova/instances/23af7614-b27e-4e97-8180-5289cf8d9bcc/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Start _get_guest_xml network_info=[{"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '30166a87-ebd8-4562-aa49-2c9767cdff37', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUKLZMSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23af7614-b27e-4e97-8180-5289cf8d9bcc', 'attached_at': '', 'detached_at': '', 'volume_id': '0ae7a199-f84b-49aa-9543-be68e4b9e914', 'serial': '0ae7a199-f84b-49aa-9543-be68e4b9e914'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '20962994-b5b8-45ed-a343-cda921a775b2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXVMiALw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23af7614-b27e-4e97-8180-5289cf8d9bcc', 'attached_at': '', 'detached_at': '', 'volume_id': '947e2435-253d-489b-9f1a-24dfd22c5cc7', 'serial': '947e2435-253d-489b-9f1a-24dfd22c5cc7'}, 'device_type': 'disk', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': 'd67b9b50-fbb6-48c4-80e1-7d6adfb0913f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKneTmIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23af7614-b27e-4e97-8180-5289cf8d9bcc', 'attached_at': '', 'detached_at': '', 'volume_id': 'b24e73d0-63fc-4066-9ebc-d70188fcea5b', 'serial': 'b24e73d0-63fc-4066-9ebc-d70188fcea5b'}, 'device_type': 'disk', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:08 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:39:08 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUKLZMSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:08 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:08 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:08 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:39:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:08 user nova-compute[73068]: WARNING nova.compute.manager [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 for instance with vm_state building and task_state spawning.
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:08 user nova-compute[73068]: WARNING nova.compute.manager [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-23a55e92-430b-4393-8957-cfc9dce489be for instance with vm_state building and task_state spawning.
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:08 user nova-compute[73068]: WARNING nova.compute.manager [req-0aa1ceee-64d7-4ada-8965-6ad80dfca797 req-1c692f3b-0006-44e7-8f2d-dccbd5222e24 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-23a55e92-430b-4393-8957-cfc9dce489be for instance with vm_state building and task_state spawning.
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff239e6f-cf61-4168-89d0-12d0cccef45f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:39:08 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7ba6d-f864-450d-b24b-173e3498ef01]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914] added
Aug 26 11:39:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8192abe2-5b64-4b3c-9be0-c599cbbb1dc1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c649ea7-61d6-4ea7-a87a-bc8d36598228]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rUKLZMSY {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rUKLZMSY" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f6b9de-4bab-4206-ad9e-73f7fb6dcce8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rUKLZMSY'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4149afe3-7769-4f98-8d33-3753058dda17]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddea5e98-6b00-44cb-a744-61ad5a1b951e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[076fc0c3-270c-40f9-a515-506669422d3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914, portal: 172.16.0.220,3260]
Aug 26 11:39:08 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5e9c14-c37c-41f3-b6eb-5ac172679eb7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1df72ad-f647-4e23-9888-33232fffa9ab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:39:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc5543c-ff42-4ede-975d-4bd2af90b55a]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUKLZMSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.compute.manager [req-b2247cf3-9e61-4509-9e61-85a76068b715 req-ca3cb5bf-182d-48b8-a14e-6ff59fc5d730 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b2247cf3-9e61-4509-9e61-85a76068b715 req-ca3cb5bf-182d-48b8-a14e-6ff59fc5d730 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b2247cf3-9e61-4509-9e61-85a76068b715 req-ca3cb5bf-182d-48b8-a14e-6ff59fc5d730 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b2247cf3-9e61-4509-9e61-85a76068b715 req-ca3cb5bf-182d-48b8-a14e-6ff59fc5d730 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.compute.manager [req-b2247cf3-9e61-4509-9e61-85a76068b715 req-ca3cb5bf-182d-48b8-a14e-6ff59fc5d730 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:09 user nova-compute[73068]: WARNING nova.compute.manager [req-b2247cf3-9e61-4509-9e61-85a76068b715 req-ca3cb5bf-182d-48b8-a14e-6ff59fc5d730 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 for instance with vm_state building and task_state spawning.
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049949.6392689, 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:39:09 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] VM Resumed (Lifecycle Event)
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:39:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Instance spawned successfully.
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:39:09 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049949.6430976, 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:39:09 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] VM Started (Lifecycle Event)
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:09 user nova-compute[73068]: INFO nova.compute.manager [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Took 12.26 seconds to spawn the instance on the hypervisor.
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:39:09 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:39:09 user nova-compute[73068]: INFO nova.compute.manager [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Took 51.48 seconds to build instance.
Aug 26 11:39:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-09d21261-718e-43dd-be0a-08d61b490187 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.593s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.698s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] <== connect_volume: return (1700ms) {'type': 'block', 'scsi_wwn': '23361343761616566', 'path': '/dev/sdg'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361343761616566', 'path': '/dev/sdg'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.objects.instance [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lazy-loading 'flavor' on Instance uuid 85b6aa5b-72c1-415f-8552-19d0cd3859d6 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXVMiALw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:10 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:10 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:10 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[210f6440-915f-43bb-9e98-7a6025f37107]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:39:10 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de6a070-86c8-4123-98cf-0dd227494f83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7] added
Aug 26 11:39:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce54f86-2696-4902-8949-d34ab301a128]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d2a4d0-7093-486b-9412-2132354e15b8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXVMiALw {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXVMiALw" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cae5588-0f49-4698-b2be-61761688330a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YXVMiALw'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[452deba3-6364-4f8a-be90-4572077463dd]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:10 user nova-compute[73068]: INFO nova.compute.manager [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Attaching volume 6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d to /dev/sdc
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c7e94e-d118-4946-b6d3-09e6b2ccb758]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "a86048fe-ddbb-49b3-b2da-8efc895346ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:10 user nova-compute[73068]: WARNING nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 for instance with vm_state active and task_state None.
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:10 user nova-compute[73068]: WARNING nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 for instance with vm_state active and task_state None.
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-changed-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Refreshing instance network info cache due to event network-changed-5b01dafe-b0f5-420a-9c1f-dfc578e12679. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Acquiring lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Acquired lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.network.neutron [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Refreshing network info cache for port 5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.utils [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.121s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[204dd960-f9c8-47f4-989d-a066c2dffd47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7, portal: 172.16.0.220,3260]
Aug 26 11:39:10 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff1d23d-ff05-4884-9ad0-78c71ecd3af0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b719e7a-a9d2-4264-a5a8-3d595816fb14]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c49a46-926f-44cd-9e52-56921913be40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8222e660-cd24-4918-8765-995e940dc10f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4060eb93-32fe-4c12-8895-39f2e899b8db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5677d42f-5047-4a5d-99f9-4c5d4038442c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.479s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cf8288-56bb-4c84-98b0-4731e1a4661e]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXVMiALw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:39:10 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4a49b0-e2bf-4284-85a0-9c1913e60252]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG os_brick.utils [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Updating existing volume attachment record: 81ff7be2-46ea-4f6d-b0f7-52aaa3706478 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:10 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:39:10 user nova-compute[73068]: INFO nova.compute.claims [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Claim successful on node user
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Updated VIF entry in instance network info cache for port 5b01dafe-b0f5-420a-9c1f-dfc578e12679. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Updating instance_info_cache with network_info: [{"id": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "address": "fa:16:3e:7f:de:1f", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01dafe-b0", "ovs_interfaceid": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Releasing lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:11 user nova-compute[73068]: WARNING nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-9106173f-4454-446d-a434-3222ed390edf for instance with vm_state active and task_state None.
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:11 user nova-compute[73068]: WARNING nova.compute.manager [req-11243b0c-24a9-488e-bb7a-0ba65086776c req-94c3119f-ac3b-4a73-a89c-fcc102419327 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-9106173f-4454-446d-a434-3222ed390edf for instance with vm_state active and task_state None.
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:39:11 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.policy [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '613022b47a2e40ca949864fa83fa2e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f7f84d7714f8d94971cae316c2215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:39:11 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Creating image(s)
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "/opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "/opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "/opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.553s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] <== connect_volume: return (1557ms) {'type': 'block', 'scsi_wwn': '23763343064616166', 'path': '/dev/sdh'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763343064616166', 'path': '/dev/sdh'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKneTmIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:11 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:11 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:11 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:12 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:12 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a71eeed-cb26-44fb-ba04-7d2ff4dd0014]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:39:12 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5853b182-66c8-4363-9a93-71a547d94285]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b] added
Aug 26 11:39:12 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3077229a-cc9a-42ab-831a-2acbb8904f9a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f579dc-adba-4625-a224-9a115234be19]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FKneTmIL {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.207s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FKneTmIL" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e23bf72-5aa3-4887-98df-f55375f48155]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FKneTmIL'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf072c12-2953-42ca-bbef-be126616f879]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk 1073741824" returned: 0 in 0.087s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7610b6f-4bdb-4b6b-8e9a-667a7683de09]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[709b2847-cc9a-4990-94bb-2d803a7c459b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b, portal: 172.16.0.220,3260]
Aug 26 11:39:12 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:12 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51b2bca-f4de-4e5b-b2c6-1cde86cc0430]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.222s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d91a68-63ea-42c6-b416-c8aad484d250]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:12 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:12 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:12 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.508s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.035s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee774230-5bb0-46f6-940a-ade05e34b99a]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKneTmIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Successfully created port: 47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Cannot resize image /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Ensure instance console log exists: /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.580s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] <== connect_volume: return (1585ms) {'type': 'block', 'scsi_wwn': '23665333865383331', 'path': '/dev/sdi'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665333865383331', 'path': '/dev/sdi'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f0:f0,bridge_name='br-int',has_traffic_filtering=True,id=13c74443-704c-42ea-a6c9-318fdb45bf39,network=Network(30547f21-ccab-478e-9b3a-10ed8863f9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c74443-70') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=b8349c53-2931-4166-9c38-83acbd21a526,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8349c53-29') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f3:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d526e58-f0c8-4959-a451-267b715b2eff,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d526e58-f0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:d9,bridge_name='br-int',has_traffic_filtering=True,id=e9c95ec3-dbcc-4eb5-8787-788c1ea7d118,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c95ec3-db') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d5:47,bridge_name='br-int',has_traffic_filtering=True,id=10b083eb-5813-4a51-8e7d-9fd1afbdd97b,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b083eb-58') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:26:3f,bridge_name='br-int',has_traffic_filtering=True,id=27a00e05-7181-4d39-92ab-121218d84e48,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a00e05-71') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=6063758d-5a93-4b48-9d31-fad4e01a7e9c,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063758d-5a') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.objects.instance [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lazy-loading 'pci_devices' on Instance uuid 23af7614-b27e-4e97-8180-5289cf8d9bcc {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:39:13 user nova-compute[73068]:   <uuid>23af7614-b27e-4e97-8180-5289cf8d9bcc</uuid>
Aug 26 11:39:13 user nova-compute[73068]:   <name>instance-0000000b</name>
Aug 26 11:39:13 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:39:13 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:39:13 user nova-compute[73068]:   <metadata>
Aug 26 11:39:13 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:39:13 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:39:13 user nova-compute[73068]:       <nova:name>tempest-device-tagging-server-1565346184</nova:name>
Aug 26 11:39:13 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:39:08</nova:creationTime>
Aug 26 11:39:13 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:39:13 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:39:13 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:39:13 user nova-compute[73068]:       <nova:owner>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:user uuid="6f8b15786de34d59b9d0b2f061640b56">tempest-TaggedBootDevicesTest_v242-760066924-project-member</nova:user>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:project uuid="b3d06304213c49a58e2896200963e7f4">tempest-TaggedBootDevicesTest_v242-760066924</nova:project>
Aug 26 11:39:13 user nova-compute[73068]:       </nova:owner>
Aug 26 11:39:13 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:39:13 user nova-compute[73068]:       <nova:ports>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:port uuid="13c74443-704c-42ea-a6c9-318fdb45bf39">
Aug 26 11:39:13 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 11:39:13 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:port uuid="b8349c53-2931-4166-9c38-83acbd21a526">
Aug 26 11:39:13 user nova-compute[73068]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
Aug 26 11:39:13 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:port uuid="7d526e58-f0c8-4959-a451-267b715b2eff">
Aug 26 11:39:13 user nova-compute[73068]:           <nova:ip type="fixed" address="10.1.1.45" ipVersion="4"/>
Aug 26 11:39:13 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:port uuid="e9c95ec3-dbcc-4eb5-8787-788c1ea7d118">
Aug 26 11:39:13 user nova-compute[73068]:           <nova:ip type="fixed" address="10.1.1.215" ipVersion="4"/>
Aug 26 11:39:13 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:port uuid="10b083eb-5813-4a51-8e7d-9fd1afbdd97b">
Aug 26 11:39:13 user nova-compute[73068]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
Aug 26 11:39:13 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:port uuid="27a00e05-7181-4d39-92ab-121218d84e48">
Aug 26 11:39:13 user nova-compute[73068]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 11:39:13 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:13 user nova-compute[73068]:         <nova:port uuid="6063758d-5a93-4b48-9d31-fad4e01a7e9c">
Aug 26 11:39:13 user nova-compute[73068]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 11:39:13 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:13 user nova-compute[73068]:       </nova:ports>
Aug 26 11:39:13 user nova-compute[73068]:     </nova:instance>
Aug 26 11:39:13 user nova-compute[73068]:   </metadata>
Aug 26 11:39:13 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:39:13 user nova-compute[73068]:     <system>
Aug 26 11:39:13 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:39:13 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:39:13 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:39:13 user nova-compute[73068]:       <entry name="serial">23af7614-b27e-4e97-8180-5289cf8d9bcc</entry>
Aug 26 11:39:13 user nova-compute[73068]:       <entry name="uuid">23af7614-b27e-4e97-8180-5289cf8d9bcc</entry>
Aug 26 11:39:13 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:39:13 user nova-compute[73068]:     </system>
Aug 26 11:39:13 user nova-compute[73068]:   </sysinfo>
Aug 26 11:39:13 user nova-compute[73068]:   <os>
Aug 26 11:39:13 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:39:13 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:39:13 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:39:13 user nova-compute[73068]:   </os>
Aug 26 11:39:13 user nova-compute[73068]:   <features>
Aug 26 11:39:13 user nova-compute[73068]:     <acpi/>
Aug 26 11:39:13 user nova-compute[73068]:     <apic/>
Aug 26 11:39:13 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:39:13 user nova-compute[73068]:   </features>
Aug 26 11:39:13 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:39:13 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:39:13 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:39:13 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:39:13 user nova-compute[73068]:   </clock>
Aug 26 11:39:13 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:39:13 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:39:13 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:39:13 user nova-compute[73068]:   </cpu>
Aug 26 11:39:13 user nova-compute[73068]:   <devices>
Aug 26 11:39:13 user nova-compute[73068]:     <disk type="file" device="cdrom">
Aug 26 11:39:13 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 11:39:13 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/23af7614-b27e-4e97-8180-5289cf8d9bcc/disk.config"/>
Aug 26 11:39:13 user nova-compute[73068]:       <target dev="hda" bus="ide"/>
Aug 26 11:39:13 user nova-compute[73068]:     </disk>
Aug 26 11:39:13 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:39:13 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:13 user nova-compute[73068]:       <source dev="/dev/sdg"/>
Aug 26 11:39:13 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:39:13 user nova-compute[73068]:       <serial>0ae7a199-f84b-49aa-9543-be68e4b9e914</serial>
Aug 26 11:39:13 user nova-compute[73068]:     </disk>
Aug 26 11:39:13 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:39:13 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:13 user nova-compute[73068]:       <source dev="/dev/sdh"/>
Aug 26 11:39:13 user nova-compute[73068]:       <target dev="vdb" bus="virtio"/>
Aug 26 11:39:13 user nova-compute[73068]:       <serial>947e2435-253d-489b-9f1a-24dfd22c5cc7</serial>
Aug 26 11:39:13 user nova-compute[73068]:     </disk>
Aug 26 11:39:13 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:39:13 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:13 user nova-compute[73068]:       <source dev="/dev/sdi"/>
Aug 26 11:39:13 user nova-compute[73068]:       <target dev="vdc" bus="virtio"/>
Aug 26 11:39:13 user nova-compute[73068]:       <serial>b24e73d0-63fc-4066-9ebc-d70188fcea5b</serial>
Aug 26 11:39:13 user nova-compute[73068]:     </disk>
Aug 26 11:39:13 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:13 user nova-compute[73068]:       <mac address="fa:16:3e:ed:f0:f0"/>
Aug 26 11:39:13 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:13 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:13 user nova-compute[73068]:       <target dev="tap13c74443-70"/>
Aug 26 11:39:13 user nova-compute[73068]:     </interface>
Aug 26 11:39:13 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:13 user nova-compute[73068]:       <mac address="fa:16:3e:c3:00:f3"/>
Aug 26 11:39:13 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:13 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:13 user nova-compute[73068]:       <target dev="tapb8349c53-29"/>
Aug 26 11:39:13 user nova-compute[73068]:     </interface>
Aug 26 11:39:13 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:13 user nova-compute[73068]:       <mac address="fa:16:3e:7b:f3:a1"/>
Aug 26 11:39:13 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:13 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:13 user nova-compute[73068]:       <target dev="tap7d526e58-f0"/>
Aug 26 11:39:13 user nova-compute[73068]:     </interface>
Aug 26 11:39:13 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:13 user nova-compute[73068]:       <mac address="fa:16:3e:e0:63:d9"/>
Aug 26 11:39:13 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:13 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:13 user nova-compute[73068]:       <target dev="tape9c95ec3-db"/>
Aug 26 11:39:13 user nova-compute[73068]:     </interface>
Aug 26 11:39:13 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:13 user nova-compute[73068]:       <mac address="fa:16:3e:e7:d5:47"/>
Aug 26 11:39:13 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:13 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:13 user nova-compute[73068]:       <target dev="tap10b083eb-58"/>
Aug 26 11:39:13 user nova-compute[73068]:     </interface>
Aug 26 11:39:13 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:13 user nova-compute[73068]:       <mac address="fa:16:3e:e4:26:3f"/>
Aug 26 11:39:13 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:13 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:13 user nova-compute[73068]:       <target dev="tap27a00e05-71"/>
Aug 26 11:39:13 user nova-compute[73068]:     </interface>
Aug 26 11:39:13 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:13 user nova-compute[73068]:       <mac address="fa:16:3e:49:8c:a2"/>
Aug 26 11:39:13 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:13 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:13 user nova-compute[73068]:       <target dev="tap6063758d-5a"/>
Aug 26 11:39:13 user nova-compute[73068]:     </interface>
Aug 26 11:39:13 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:39:13 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/23af7614-b27e-4e97-8180-5289cf8d9bcc/console.log" append="off"/>
Aug 26 11:39:13 user nova-compute[73068]:     </serial>
Aug 26 11:39:13 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:39:13 user nova-compute[73068]:     <video>
Aug 26 11:39:13 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:13 user nova-compute[73068]:     </video>
Aug 26 11:39:13 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:39:13 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:39:13 user nova-compute[73068]:     </rng>
Aug 26 11:39:13 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:39:13 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:39:13 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:39:13 user nova-compute[73068]:     </memballoon>
Aug 26 11:39:13 user nova-compute[73068]:   </devices>
Aug 26 11:39:13 user nova-compute[73068]: </domain>
Aug 26 11:39:13 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f0:f0,bridge_name='br-int',has_traffic_filtering=True,id=13c74443-704c-42ea-a6c9-318fdb45bf39,network=Network(30547f21-ccab-478e-9b3a-10ed8863f9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c74443-70') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f0:f0,bridge_name='br-int',has_traffic_filtering=True,id=13c74443-704c-42ea-a6c9-318fdb45bf39,network=Network(30547f21-ccab-478e-9b3a-10ed8863f9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c74443-70') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13c74443-70, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13c74443-70, col_values=(('external_ids', {'iface-id': '13c74443-704c-42ea-a6c9-318fdb45bf39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:f0:f0', 'vm-uuid': '23af7614-b27e-4e97-8180-5289cf8d9bcc'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: INFO os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:f0:f0,bridge_name='br-int',has_traffic_filtering=True,id=13c74443-704c-42ea-a6c9-318fdb45bf39,network=Network(30547f21-ccab-478e-9b3a-10ed8863f9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c74443-70')
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=b8349c53-2931-4166-9c38-83acbd21a526,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8349c53-29') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=b8349c53-2931-4166-9c38-83acbd21a526,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8349c53-29') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8349c53-29, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8349c53-29, col_values=(('external_ids', {'iface-id': 'b8349c53-2931-4166-9c38-83acbd21a526', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:00:f3', 'vm-uuid': '23af7614-b27e-4e97-8180-5289cf8d9bcc'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: INFO os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=b8349c53-2931-4166-9c38-83acbd21a526,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8349c53-29')
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f3:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d526e58-f0c8-4959-a451-267b715b2eff,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d526e58-f0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f3:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d526e58-f0c8-4959-a451-267b715b2eff,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d526e58-f0') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d526e58-f0, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d526e58-f0, col_values=(('external_ids', {'iface-id': '7d526e58-f0c8-4959-a451-267b715b2eff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:f3:a1', 'vm-uuid': '23af7614-b27e-4e97-8180-5289cf8d9bcc'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: INFO os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f3:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d526e58-f0c8-4959-a451-267b715b2eff,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d526e58-f0')
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:d9,bridge_name='br-int',has_traffic_filtering=True,id=e9c95ec3-dbcc-4eb5-8787-788c1ea7d118,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c95ec3-db') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:d9,bridge_name='br-int',has_traffic_filtering=True,id=e9c95ec3-dbcc-4eb5-8787-788c1ea7d118,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c95ec3-db') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9c95ec3-db, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9c95ec3-db, col_values=(('external_ids', {'iface-id': 'e9c95ec3-dbcc-4eb5-8787-788c1ea7d118', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:63:d9', 'vm-uuid': '23af7614-b27e-4e97-8180-5289cf8d9bcc'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Successfully updated port: 47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: INFO os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:d9,bridge_name='br-int',has_traffic_filtering=True,id=e9c95ec3-dbcc-4eb5-8787-788c1ea7d118,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c95ec3-db')
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d5:47,bridge_name='br-int',has_traffic_filtering=True,id=10b083eb-5813-4a51-8e7d-9fd1afbdd97b,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b083eb-58') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d5:47,bridge_name='br-int',has_traffic_filtering=True,id=10b083eb-5813-4a51-8e7d-9fd1afbdd97b,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b083eb-58') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "refresh_cache-a86048fe-ddbb-49b3-b2da-8efc895346ba" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquired lock "refresh_cache-a86048fe-ddbb-49b3-b2da-8efc895346ba" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10b083eb-58, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10b083eb-58, col_values=(('external_ids', {'iface-id': '10b083eb-5813-4a51-8e7d-9fd1afbdd97b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:d5:47', 'vm-uuid': '23af7614-b27e-4e97-8180-5289cf8d9bcc'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-4e80e5ea-ed67-482a-8e1b-8d55c20fb60d req-b7879a96-fec4-4601-86c3-722f7c98cc3b service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Received event network-changed-47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-4e80e5ea-ed67-482a-8e1b-8d55c20fb60d req-b7879a96-fec4-4601-86c3-722f7c98cc3b service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Refreshing instance network info cache due to event network-changed-47d313d2-edb6-4cb5-8739-505b93a3c024. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4e80e5ea-ed67-482a-8e1b-8d55c20fb60d req-b7879a96-fec4-4601-86c3-722f7c98cc3b service nova] Acquiring lock "refresh_cache-a86048fe-ddbb-49b3-b2da-8efc895346ba" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: INFO os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d5:47,bridge_name='br-int',has_traffic_filtering=True,id=10b083eb-5813-4a51-8e7d-9fd1afbdd97b,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b083eb-58')
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:26:3f,bridge_name='br-int',has_traffic_filtering=True,id=27a00e05-7181-4d39-92ab-121218d84e48,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a00e05-71') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:26:3f,bridge_name='br-int',has_traffic_filtering=True,id=27a00e05-7181-4d39-92ab-121218d84e48,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a00e05-71') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27a00e05-71, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27a00e05-71, col_values=(('external_ids', {'iface-id': '27a00e05-7181-4d39-92ab-121218d84e48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:26:3f', 'vm-uuid': '23af7614-b27e-4e97-8180-5289cf8d9bcc'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:14 user nova-compute[73068]: INFO os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:26:3f,bridge_name='br-int',has_traffic_filtering=True,id=27a00e05-7181-4d39-92ab-121218d84e48,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a00e05-71')
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=6063758d-5a93-4b48-9d31-fad4e01a7e9c,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063758d-5a') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=6063758d-5a93-4b48-9d31-fad4e01a7e9c,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063758d-5a') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6063758d-5a, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6063758d-5a, col_values=(('external_ids', {'iface-id': '6063758d-5a93-4b48-9d31-fad4e01a7e9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:8c:a2', 'vm-uuid': '23af7614-b27e-4e97-8180-5289cf8d9bcc'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:14 user nova-compute[73068]: INFO os_vif [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=6063758d-5a93-4b48-9d31-fad4e01a7e9c,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063758d-5a')
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] No BDM found with device name hda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] No VIF found with MAC fa:16:3e:ed:f0:f0, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] No VIF found with MAC fa:16:3e:e7:d5:47, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:39:14 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Using config drive
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Updating instance_info_cache with network_info: [{"id": "47d313d2-edb6-4cb5-8739-505b93a3c024", "address": "fa:16:3e:b0:c9:24", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d313d2-ed", "ovs_interfaceid": "47d313d2-edb6-4cb5-8739-505b93a3c024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Releasing lock "refresh_cache-a86048fe-ddbb-49b3-b2da-8efc895346ba" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Instance network_info: |[{"id": "47d313d2-edb6-4cb5-8739-505b93a3c024", "address": "fa:16:3e:b0:c9:24", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d313d2-ed", "ovs_interfaceid": "47d313d2-edb6-4cb5-8739-505b93a3c024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4e80e5ea-ed67-482a-8e1b-8d55c20fb60d req-b7879a96-fec4-4601-86c3-722f7c98cc3b service nova] Acquired lock "refresh_cache-a86048fe-ddbb-49b3-b2da-8efc895346ba" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-4e80e5ea-ed67-482a-8e1b-8d55c20fb60d req-b7879a96-fec4-4601-86c3-722f7c98cc3b service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Refreshing network info cache for port 47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Start _get_guest_xml network_info=[{"id": "47d313d2-edb6-4cb5-8739-505b93a3c024", "address": "fa:16:3e:b0:c9:24", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d313d2-ed", "ovs_interfaceid": "47d313d2-edb6-4cb5-8739-505b93a3c024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:39:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:39:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:39:14 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Creating config drive at /opt/stack/data/nova/instances/23af7614-b27e-4e97-8180-5289cf8d9bcc/disk.config
Aug 26 11:39:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/23af7614-b27e-4e97-8180-5289cf8d9bcc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpg20j93te {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688511533',display_name='tempest-AttachVolumeNegativeTest-server-688511533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688511533',id=13,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp/+v/GYAXkEO2Pz8iTkGQ/GylkhdnMvHFpXYw+qSEopj6BE8vHfCpC6Qk/LqFgW8MtdATtObwmMDe/e+iAPHOfcWZ/tEn6DYH3fDhymx99UgcjFHmy8RK9Se+r8FhTXw==',key_name='tempest-keypair-882447336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-e4of5lhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:39:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=a86048fe-ddbb-49b3-b2da-8efc895346ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47d313d2-edb6-4cb5-8739-505b93a3c024", "address": "fa:16:3e:b0:c9:24", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d313d2-ed", "ovs_interfaceid": "47d313d2-edb6-4cb5-8739-505b93a3c024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "47d313d2-edb6-4cb5-8739-505b93a3c024", "address": "fa:16:3e:b0:c9:24", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d313d2-ed", "ovs_interfaceid": "47d313d2-edb6-4cb5-8739-505b93a3c024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c9:24,bridge_name='br-int',has_traffic_filtering=True,id=47d313d2-edb6-4cb5-8739-505b93a3c024,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d313d2-ed') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'pci_devices' on Instance uuid a86048fe-ddbb-49b3-b2da-8efc895346ba {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/23af7614-b27e-4e97-8180-5289cf8d9bcc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpg20j93te" returned: 0 in 0.109s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:39:14 user nova-compute[73068]:   <uuid>a86048fe-ddbb-49b3-b2da-8efc895346ba</uuid>
Aug 26 11:39:14 user nova-compute[73068]:   <name>instance-0000000d</name>
Aug 26 11:39:14 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:39:14 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:39:14 user nova-compute[73068]:   <metadata>
Aug 26 11:39:14 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:39:14 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:39:14 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeNegativeTest-server-688511533</nova:name>
Aug 26 11:39:14 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:39:14</nova:creationTime>
Aug 26 11:39:14 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:39:14 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:39:14 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:39:14 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:39:14 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:39:14 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:39:14 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:39:14 user nova-compute[73068]:       <nova:owner>
Aug 26 11:39:14 user nova-compute[73068]:         <nova:user uuid="613022b47a2e40ca949864fa83fa2e73">tempest-AttachVolumeNegativeTest-1321002765-project-member</nova:user>
Aug 26 11:39:14 user nova-compute[73068]:         <nova:project uuid="770f7f84d7714f8d94971cae316c2215">tempest-AttachVolumeNegativeTest-1321002765</nova:project>
Aug 26 11:39:14 user nova-compute[73068]:       </nova:owner>
Aug 26 11:39:14 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:39:14 user nova-compute[73068]:       <nova:ports>
Aug 26 11:39:14 user nova-compute[73068]:         <nova:port uuid="47d313d2-edb6-4cb5-8739-505b93a3c024">
Aug 26 11:39:14 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 11:39:14 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:14 user nova-compute[73068]:       </nova:ports>
Aug 26 11:39:14 user nova-compute[73068]:     </nova:instance>
Aug 26 11:39:14 user nova-compute[73068]:   </metadata>
Aug 26 11:39:14 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:39:14 user nova-compute[73068]:     <system>
Aug 26 11:39:14 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:39:14 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:39:14 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:39:14 user nova-compute[73068]:       <entry name="serial">a86048fe-ddbb-49b3-b2da-8efc895346ba</entry>
Aug 26 11:39:14 user nova-compute[73068]:       <entry name="uuid">a86048fe-ddbb-49b3-b2da-8efc895346ba</entry>
Aug 26 11:39:14 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:39:14 user nova-compute[73068]:     </system>
Aug 26 11:39:14 user nova-compute[73068]:   </sysinfo>
Aug 26 11:39:14 user nova-compute[73068]:   <os>
Aug 26 11:39:14 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:39:14 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:39:14 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:39:14 user nova-compute[73068]:   </os>
Aug 26 11:39:14 user nova-compute[73068]:   <features>
Aug 26 11:39:14 user nova-compute[73068]:     <acpi/>
Aug 26 11:39:14 user nova-compute[73068]:     <apic/>
Aug 26 11:39:14 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:39:14 user nova-compute[73068]:   </features>
Aug 26 11:39:14 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:39:14 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:39:14 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:39:14 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:39:14 user nova-compute[73068]:   </clock>
Aug 26 11:39:14 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:39:14 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:39:14 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:39:14 user nova-compute[73068]:   </cpu>
Aug 26 11:39:14 user nova-compute[73068]:   <devices>
Aug 26 11:39:14 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:39:14 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:39:14 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk"/>
Aug 26 11:39:14 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:39:14 user nova-compute[73068]:     </disk>
Aug 26 11:39:14 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:14 user nova-compute[73068]:       <mac address="fa:16:3e:b0:c9:24"/>
Aug 26 11:39:14 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:14 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:14 user nova-compute[73068]:       <target dev="tap47d313d2-ed"/>
Aug 26 11:39:14 user nova-compute[73068]:     </interface>
Aug 26 11:39:14 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:39:14 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/console.log" append="off"/>
Aug 26 11:39:14 user nova-compute[73068]:     </serial>
Aug 26 11:39:14 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:39:14 user nova-compute[73068]:     <video>
Aug 26 11:39:14 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:14 user nova-compute[73068]:     </video>
Aug 26 11:39:14 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:39:14 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:39:14 user nova-compute[73068]:     </rng>
Aug 26 11:39:14 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:39:14 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:39:14 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:39:14 user nova-compute[73068]:     </memballoon>
Aug 26 11:39:14 user nova-compute[73068]:   </devices>
Aug 26 11:39:14 user nova-compute[73068]: </domain>
Aug 26 11:39:14 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688511533',display_name='tempest-AttachVolumeNegativeTest-server-688511533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688511533',id=13,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp/+v/GYAXkEO2Pz8iTkGQ/GylkhdnMvHFpXYw+qSEopj6BE8vHfCpC6Qk/LqFgW8MtdATtObwmMDe/e+iAPHOfcWZ/tEn6DYH3fDhymx99UgcjFHmy8RK9Se+r8FhTXw==',key_name='tempest-keypair-882447336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-e4of5lhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:39:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=a86048fe-ddbb-49b3-b2da-8efc895346ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47d313d2-edb6-4cb5-8739-505b93a3c024", "address": "fa:16:3e:b0:c9:24", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d313d2-ed", "ovs_interfaceid": "47d313d2-edb6-4cb5-8739-505b93a3c024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "47d313d2-edb6-4cb5-8739-505b93a3c024", "address": "fa:16:3e:b0:c9:24", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d313d2-ed", "ovs_interfaceid": "47d313d2-edb6-4cb5-8739-505b93a3c024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c9:24,bridge_name='br-int',has_traffic_filtering=True,id=47d313d2-edb6-4cb5-8739-505b93a3c024,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d313d2-ed') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG os_vif [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c9:24,bridge_name='br-int',has_traffic_filtering=True,id=47d313d2-edb6-4cb5-8739-505b93a3c024,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d313d2-ed') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47d313d2-ed, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47d313d2-ed, col_values=(('external_ids', {'iface-id': '47d313d2-edb6-4cb5-8739-505b93a3c024', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:c9:24', 'vm-uuid': 'a86048fe-ddbb-49b3-b2da-8efc895346ba'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:14 user nova-compute[73068]: INFO os_vif [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c9:24,bridge_name='br-int',has_traffic_filtering=True,id=47d313d2-edb6-4cb5-8739-505b93a3c024,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d313d2-ed')
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No VIF found with MAC fa:16:3e:b0:c9:24, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:14 user nova-compute[73068]: DEBUG nova.objects.instance [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lazy-loading 'flavor' on Instance uuid 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG nova.network.neutron [req-4e80e5ea-ed67-482a-8e1b-8d55c20fb60d req-b7879a96-fec4-4601-86c3-722f7c98cc3b service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Updated VIF entry in instance network info cache for port 47d313d2-edb6-4cb5-8739-505b93a3c024. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG nova.network.neutron [req-4e80e5ea-ed67-482a-8e1b-8d55c20fb60d req-b7879a96-fec4-4601-86c3-722f7c98cc3b service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Updating instance_info_cache with network_info: [{"id": "47d313d2-edb6-4cb5-8739-505b93a3c024", "address": "fa:16:3e:b0:c9:24", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d313d2-ed", "ovs_interfaceid": "47d313d2-edb6-4cb5-8739-505b93a3c024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4e80e5ea-ed67-482a-8e1b-8d55c20fb60d req-b7879a96-fec4-4601-86c3-722f7c98cc3b service nova] Releasing lock "refresh_cache-a86048fe-ddbb-49b3-b2da-8efc895346ba" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:15 user nova-compute[73068]: INFO nova.compute.manager [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Attaching volume f4b68aa5-4d76-457c-a569-6b1b9484ef30 to /dev/vdb
Aug 26 11:39:15 user nova-compute[73068]: DEBUG os_brick.utils [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[441bc5ea-5194-4899-a2b8-c0778820a533]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ac3180-029f-4bd0-91cd-37d9365c4379]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b069ecc-e11e-41eb-9225-c0564c03312c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c63d606-a6d7-4fdf-aa9f-23d466cb9e96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:39:15 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:39:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c28538-4b63-4d26-ab80-f67262e46408]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG os_brick.utils [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:15 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Updating existing volume attachment record: 072e1abd-6f48-46de-8a03-0023fdd46a55 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-5c21ab85-4c88-413e-9d5f-f736b8f523a4 req-9707d758-2e7f-44f5-802d-a1139462a703 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Received event network-changed-ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-5c21ab85-4c88-413e-9d5f-f736b8f523a4 req-9707d758-2e7f-44f5-802d-a1139462a703 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Refreshing instance network info cache due to event network-changed-ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5c21ab85-4c88-413e-9d5f-f736b8f523a4 req-9707d758-2e7f-44f5-802d-a1139462a703 service nova] Acquiring lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5c21ab85-4c88-413e-9d5f-f736b8f523a4 req-9707d758-2e7f-44f5-802d-a1139462a703 service nova] Acquired lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG nova.network.neutron [req-5c21ab85-4c88-413e-9d5f-f736b8f523a4 req-9707d758-2e7f-44f5-802d-a1139462a703 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Refreshing network info cache for port ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:39:17 user nova-compute[73068]: INFO nova.compute.claims [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Claim successful on node user
Aug 26 11:39:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "792b5efb-63fa-4e87-b114-61de6180b2c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lazy-loading 'flavor' on Instance uuid 792b5efb-63fa-4e87-b114-61de6180b2c6 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG nova.network.neutron [req-5c21ab85-4c88-413e-9d5f-f736b8f523a4 req-9707d758-2e7f-44f5-802d-a1139462a703 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Updated VIF entry in instance network info cache for port ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG nova.network.neutron [req-5c21ab85-4c88-413e-9d5f-f736b8f523a4 req-9707d758-2e7f-44f5-802d-a1139462a703 service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Updating instance_info_cache with network_info: [{"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "792b5efb-63fa-4e87-b114-61de6180b2c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:18 user nova-compute[73068]: INFO nova.compute.manager [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Attaching volume 7c19634f-40b5-4e36-be22-372a0447f545 to /dev/vdb
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5c21ab85-4c88-413e-9d5f-f736b8f523a4 req-9707d758-2e7f-44f5-802d-a1139462a703 service nova] Releasing lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG os_brick.utils [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4561b720-ff3c-4b32-9ad6-1c240e70f64b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.868s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72a8cfe-9bce-450e-9b05-d6a2aee91808]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bdb6e7-7574-48e5-9ee5-9fc0f75d63b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5259c437-68e3-4a72-9e75-76ee4544a7f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG nova.network.neutron [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:39:18 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:39:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[36195903-153a-4478-a4f4-5a638c62bbb2]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:18 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:39:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG os_brick.utils [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Updating existing volume attachment record: c6f0fd44-9d5c-4a94-9a2d-a0000fc49038 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:39:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.policy [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f42e503ca2ad49479def3b68cb51a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152ceb72f1e54291a5aacf0a7403e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:39:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Creating image(s)
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "/opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "/opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "/opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Received event network-vif-plugged-47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Acquiring lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] No waiting events found dispatching network-vif-plugged-47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:19 user nova-compute[73068]: WARNING nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Received unexpected event network-vif-plugged-47d313d2-edb6-4cb5-8739-505b93a3c024 for instance with vm_state building and task_state spawning.
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Received event network-vif-plugged-47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Acquiring lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] No waiting events found dispatching network-vif-plugged-47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:19 user nova-compute[73068]: WARNING nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Received unexpected event network-vif-plugged-47d313d2-edb6-4cb5-8739-505b93a3c024 for instance with vm_state building and task_state spawning.
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:19 user nova-compute[73068]: WARNING nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-13c74443-704c-42ea-a6c9-318fdb45bf39 for instance with vm_state building and task_state spawning.
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:19 user nova-compute[73068]: WARNING nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-13c74443-704c-42ea-a6c9-318fdb45bf39 for instance with vm_state building and task_state spawning.
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-b8349c53-2931-4166-9c38-83acbd21a526 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-b8349c53-2931-4166-9c38-83acbd21a526 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:19 user nova-compute[73068]: WARNING nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-b8349c53-2931-4166-9c38-83acbd21a526 for instance with vm_state building and task_state spawning.
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-b8349c53-2931-4166-9c38-83acbd21a526 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-b8349c53-2931-4166-9c38-83acbd21a526 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:19 user nova-compute[73068]: WARNING nova.compute.manager [req-0b840dc5-2bd4-4cfb-9770-2c7bafebf6c8 req-67bbd058-168c-4848-b134-d154ba988c6f service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-b8349c53-2931-4166-9c38-83acbd21a526 for instance with vm_state building and task_state spawning.
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.231s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-99d61bf8-0585-4414-bf38-3820a45d63a5 req-8c9e3620-572c-4207-8f29-75b525697992 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-7d526e58-f0c8-4959-a451-267b715b2eff {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-99d61bf8-0585-4414-bf38-3820a45d63a5 req-8c9e3620-572c-4207-8f29-75b525697992 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-99d61bf8-0585-4414-bf38-3820a45d63a5 req-8c9e3620-572c-4207-8f29-75b525697992 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-99d61bf8-0585-4414-bf38-3820a45d63a5 req-8c9e3620-572c-4207-8f29-75b525697992 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-99d61bf8-0585-4414-bf38-3820a45d63a5 req-8c9e3620-572c-4207-8f29-75b525697992 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-7d526e58-f0c8-4959-a451-267b715b2eff {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:19 user nova-compute[73068]: WARNING nova.compute.manager [req-99d61bf8-0585-4414-bf38-3820a45d63a5 req-8c9e3620-572c-4207-8f29-75b525697992 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-7d526e58-f0c8-4959-a451-267b715b2eff for instance with vm_state building and task_state spawning.
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-5e6cf6c8-2bfb-48f2-b80b-58078b3d4668 req-9bcbf111-7abc-4356-90f0-a94d89c871ce service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5e6cf6c8-2bfb-48f2-b80b-58078b3d4668 req-9bcbf111-7abc-4356-90f0-a94d89c871ce service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5e6cf6c8-2bfb-48f2-b80b-58078b3d4668 req-9bcbf111-7abc-4356-90f0-a94d89c871ce service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5e6cf6c8-2bfb-48f2-b80b-58078b3d4668 req-9bcbf111-7abc-4356-90f0-a94d89c871ce service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-5e6cf6c8-2bfb-48f2-b80b-58078b3d4668 req-9bcbf111-7abc-4356-90f0-a94d89c871ce service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:19 user nova-compute[73068]: WARNING nova.compute.manager [req-5e6cf6c8-2bfb-48f2-b80b-58078b3d4668 req-9bcbf111-7abc-4356-90f0-a94d89c871ce service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 for instance with vm_state building and task_state spawning.
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.205s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk 1073741824" returned: 0 in 0.074s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.217s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Cannot resize image /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Ensure instance console log exists: /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG nova.network.neutron [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Successfully created port: e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:21 user nova-compute[73068]: WARNING nova.compute.manager [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-27a00e05-7181-4d39-92ab-121218d84e48 for instance with vm_state building and task_state spawning.
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:21 user nova-compute[73068]: WARNING nova.compute.manager [req-e1791093-141c-4c38-b5c6-9e9eb4e9a724 req-67df0ed5-3c6f-45fd-a604-ecc09a61111b service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-27a00e05-7181-4d39-92ab-121218d84e48 for instance with vm_state building and task_state spawning.
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-7d526e58-f0c8-4959-a451-267b715b2eff {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-7d526e58-f0c8-4959-a451-267b715b2eff {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:21 user nova-compute[73068]: WARNING nova.compute.manager [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-7d526e58-f0c8-4959-a451-267b715b2eff for instance with vm_state building and task_state spawning.
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:21 user nova-compute[73068]: WARNING nova.compute.manager [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b for instance with vm_state building and task_state spawning.
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:21 user nova-compute[73068]: WARNING nova.compute.manager [req-ab26dc6a-9eb9-4dca-8074-c3d0f3b66afb req-c4008b2f-6ba5-4c5a-9491-e4d996964766 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b for instance with vm_state building and task_state spawning.
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:21 user nova-compute[73068]: WARNING nova.compute.manager [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 for instance with vm_state building and task_state spawning.
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:21 user nova-compute[73068]: WARNING nova.compute.manager [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c for instance with vm_state building and task_state spawning.
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:21 user nova-compute[73068]: WARNING nova.compute.manager [req-ee393a9d-5031-4c42-9832-a3159560237c req-bd135f78-871a-4a4a-b338-bb832bf69255 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c for instance with vm_state building and task_state spawning.
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049961.7102125, a86048fe-ddbb-49b3-b2da-8efc895346ba => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:39:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] VM Resumed (Lifecycle Event)
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:39:21 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Instance spawned successfully.
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049961.7173944, a86048fe-ddbb-49b3-b2da-8efc895346ba => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:39:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] VM Started (Lifecycle Event)
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:39:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:39:21 user nova-compute[73068]: INFO nova.compute.manager [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Took 10.18 seconds to spawn the instance on the hypervisor.
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:21 user nova-compute[73068]: DEBUG nova.network.neutron [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Successfully updated port: e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "refresh_cache-2881e7a6-0099-4b87-819b-c36dd3db99c8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquired lock "refresh_cache-2881e7a6-0099-4b87-819b-c36dd3db99c8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.network.neutron [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:39:22 user nova-compute[73068]: INFO nova.compute.manager [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Took 11.27 seconds to build instance.
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.network.neutron [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e2076133-194a-421e-a849-5b5d252d0c2d tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.494s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.network.neutron [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Updating instance_info_cache with network_info: [{"id": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "address": "fa:16:3e:89:c9:f1", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8697f9a-2c", "ovs_interfaceid": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Releasing lock "refresh_cache-2881e7a6-0099-4b87-819b-c36dd3db99c8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Instance network_info: |[{"id": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "address": "fa:16:3e:89:c9:f1", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8697f9a-2c", "ovs_interfaceid": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Start _get_guest_xml network_info=[{"id": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "address": "fa:16:3e:89:c9:f1", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8697f9a-2c", "ovs_interfaceid": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:39:22 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:39:22 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-339323794',display_name='tempest-VolumesSnapshotTestJSON-instance-339323794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-339323794',id=14,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR1k2bfjI7J2GogD0yNTcPQ9pM9XPlg0bBfaD3flAAJlhWCCgv38k7bas5IQXNLF56gv7gWLJ52B5uwkha0Q0kkkX8I+hoVWfIC1XFSWNQDkhLflTg3SrPHuY1VhUTI0w==',key_name='tempest-keypair-1664709991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='152ceb72f1e54291a5aacf0a7403e4f0',ramdisk_id='',reservation_id='r-n9c6uptw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332483418',owner_user_name='tempest-VolumesSnapshotTestJSON-1332483418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:39:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f42e503ca2ad49479def3b68cb51a7b3',uuid=2881e7a6-0099-4b87-819b-c36dd3db99c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "address": "fa:16:3e:89:c9:f1", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8697f9a-2c", "ovs_interfaceid": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converting VIF {"id": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "address": "fa:16:3e:89:c9:f1", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8697f9a-2c", "ovs_interfaceid": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=e8697f9a-2cd5-412b-b54a-7ca067065d94,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8697f9a-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.objects.instance [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lazy-loading 'pci_devices' on Instance uuid 2881e7a6-0099-4b87-819b-c36dd3db99c8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:39:22 user nova-compute[73068]:   <uuid>2881e7a6-0099-4b87-819b-c36dd3db99c8</uuid>
Aug 26 11:39:22 user nova-compute[73068]:   <name>instance-0000000e</name>
Aug 26 11:39:22 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:39:22 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:39:22 user nova-compute[73068]:   <metadata>
Aug 26 11:39:22 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:39:22 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:39:22 user nova-compute[73068]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-339323794</nova:name>
Aug 26 11:39:22 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:39:22</nova:creationTime>
Aug 26 11:39:22 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:39:22 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:39:22 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:39:22 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:39:22 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:39:22 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:39:22 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:39:22 user nova-compute[73068]:       <nova:owner>
Aug 26 11:39:22 user nova-compute[73068]:         <nova:user uuid="f42e503ca2ad49479def3b68cb51a7b3">tempest-VolumesSnapshotTestJSON-1332483418-project-member</nova:user>
Aug 26 11:39:22 user nova-compute[73068]:         <nova:project uuid="152ceb72f1e54291a5aacf0a7403e4f0">tempest-VolumesSnapshotTestJSON-1332483418</nova:project>
Aug 26 11:39:22 user nova-compute[73068]:       </nova:owner>
Aug 26 11:39:22 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:39:22 user nova-compute[73068]:       <nova:ports>
Aug 26 11:39:22 user nova-compute[73068]:         <nova:port uuid="e8697f9a-2cd5-412b-b54a-7ca067065d94">
Aug 26 11:39:22 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 11:39:22 user nova-compute[73068]:         </nova:port>
Aug 26 11:39:22 user nova-compute[73068]:       </nova:ports>
Aug 26 11:39:22 user nova-compute[73068]:     </nova:instance>
Aug 26 11:39:22 user nova-compute[73068]:   </metadata>
Aug 26 11:39:22 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:39:22 user nova-compute[73068]:     <system>
Aug 26 11:39:22 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:39:22 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:39:22 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:39:22 user nova-compute[73068]:       <entry name="serial">2881e7a6-0099-4b87-819b-c36dd3db99c8</entry>
Aug 26 11:39:22 user nova-compute[73068]:       <entry name="uuid">2881e7a6-0099-4b87-819b-c36dd3db99c8</entry>
Aug 26 11:39:22 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:39:22 user nova-compute[73068]:     </system>
Aug 26 11:39:22 user nova-compute[73068]:   </sysinfo>
Aug 26 11:39:22 user nova-compute[73068]:   <os>
Aug 26 11:39:22 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:39:22 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:39:22 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:39:22 user nova-compute[73068]:   </os>
Aug 26 11:39:22 user nova-compute[73068]:   <features>
Aug 26 11:39:22 user nova-compute[73068]:     <acpi/>
Aug 26 11:39:22 user nova-compute[73068]:     <apic/>
Aug 26 11:39:22 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:39:22 user nova-compute[73068]:   </features>
Aug 26 11:39:22 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:39:22 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:39:22 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:39:22 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:39:22 user nova-compute[73068]:   </clock>
Aug 26 11:39:22 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:39:22 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:39:22 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:39:22 user nova-compute[73068]:   </cpu>
Aug 26 11:39:22 user nova-compute[73068]:   <devices>
Aug 26 11:39:22 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:39:22 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:39:22 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk"/>
Aug 26 11:39:22 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:39:22 user nova-compute[73068]:     </disk>
Aug 26 11:39:22 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:39:22 user nova-compute[73068]:       <mac address="fa:16:3e:89:c9:f1"/>
Aug 26 11:39:22 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:22 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:39:22 user nova-compute[73068]:       <target dev="tape8697f9a-2c"/>
Aug 26 11:39:22 user nova-compute[73068]:     </interface>
Aug 26 11:39:22 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:39:22 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/console.log" append="off"/>
Aug 26 11:39:22 user nova-compute[73068]:     </serial>
Aug 26 11:39:22 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:39:22 user nova-compute[73068]:     <video>
Aug 26 11:39:22 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:39:22 user nova-compute[73068]:     </video>
Aug 26 11:39:22 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:39:22 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:39:22 user nova-compute[73068]:     </rng>
Aug 26 11:39:22 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:39:22 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:39:22 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:39:22 user nova-compute[73068]:     </memballoon>
Aug 26 11:39:22 user nova-compute[73068]:   </devices>
Aug 26 11:39:22 user nova-compute[73068]: </domain>
Aug 26 11:39:22 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-339323794',display_name='tempest-VolumesSnapshotTestJSON-instance-339323794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-339323794',id=14,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR1k2bfjI7J2GogD0yNTcPQ9pM9XPlg0bBfaD3flAAJlhWCCgv38k7bas5IQXNLF56gv7gWLJ52B5uwkha0Q0kkkX8I+hoVWfIC1XFSWNQDkhLflTg3SrPHuY1VhUTI0w==',key_name='tempest-keypair-1664709991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='152ceb72f1e54291a5aacf0a7403e4f0',ramdisk_id='',reservation_id='r-n9c6uptw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332483418',owner_user_name='tempest-VolumesSnapshotTestJSON-1332483418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:39:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f42e503ca2ad49479def3b68cb51a7b3',uuid=2881e7a6-0099-4b87-819b-c36dd3db99c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "address": "fa:16:3e:89:c9:f1", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8697f9a-2c", "ovs_interfaceid": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converting VIF {"id": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "address": "fa:16:3e:89:c9:f1", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8697f9a-2c", "ovs_interfaceid": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=e8697f9a-2cd5-412b-b54a-7ca067065d94,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8697f9a-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG os_vif [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=e8697f9a-2cd5-412b-b54a-7ca067065d94,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8697f9a-2c') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8697f9a-2c, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8697f9a-2c, col_values=(('external_ids', {'iface-id': 'e8697f9a-2cd5-412b-b54a-7ca067065d94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:c9:f1', 'vm-uuid': '2881e7a6-0099-4b87-819b-c36dd3db99c8'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:22 user nova-compute[73068]: INFO os_vif [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=e8697f9a-2cd5-412b-b54a-7ca067065d94,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8697f9a-2c')
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] No VIF found with MAC fa:16:3e:89:c9:f1, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049963.1140227, 23af7614-b27e-4e97-8180-5289cf8d9bcc => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:39:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] VM Resumed (Lifecycle Event)
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:39:23 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Instance spawned successfully.
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049963.119858, 23af7614-b27e-4e97-8180-5289cf8d9bcc => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:39:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] VM Started (Lifecycle Event)
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:39:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:39:23 user nova-compute[73068]: INFO nova.compute.manager [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Took 14.77 seconds to spawn the instance on the hypervisor.
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:23 user nova-compute[73068]: INFO nova.compute.manager [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Took 56.69 seconds to build instance.
Aug 26 11:39:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-11496ed4-0088-410b-8c58-2589ef579d95 tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.847s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-76f61734-d7cd-43b0-bcc9-7136917e42f6 req-dddf4bd5-a7e5-48ca-a71e-3246cc1a9178 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Received event network-changed-e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-76f61734-d7cd-43b0-bcc9-7136917e42f6 req-dddf4bd5-a7e5-48ca-a71e-3246cc1a9178 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Refreshing instance network info cache due to event network-changed-e8697f9a-2cd5-412b-b54a-7ca067065d94. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-76f61734-d7cd-43b0-bcc9-7136917e42f6 req-dddf4bd5-a7e5-48ca-a71e-3246cc1a9178 service nova] Acquiring lock "refresh_cache-2881e7a6-0099-4b87-819b-c36dd3db99c8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-76f61734-d7cd-43b0-bcc9-7136917e42f6 req-dddf4bd5-a7e5-48ca-a71e-3246cc1a9178 service nova] Acquired lock "refresh_cache-2881e7a6-0099-4b87-819b-c36dd3db99c8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:39:23 user nova-compute[73068]: DEBUG nova.network.neutron [req-76f61734-d7cd-43b0-bcc9-7136917e42f6 req-dddf4bd5-a7e5-48ca-a71e-3246cc1a9178 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Refreshing network info cache for port e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG nova.network.neutron [req-76f61734-d7cd-43b0-bcc9-7136917e42f6 req-dddf4bd5-a7e5-48ca-a71e-3246cc1a9178 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Updated VIF entry in instance network info cache for port e8697f9a-2cd5-412b-b54a-7ca067065d94. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG nova.network.neutron [req-76f61734-d7cd-43b0-bcc9-7136917e42f6 req-dddf4bd5-a7e5-48ca-a71e-3246cc1a9178 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Updating instance_info_cache with network_info: [{"id": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "address": "fa:16:3e:89:c9:f1", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8697f9a-2c", "ovs_interfaceid": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-76f61734-d7cd-43b0-bcc9-7136917e42f6 req-dddf4bd5-a7e5-48ca-a71e-3246cc1a9178 service nova] Releasing lock "refresh_cache-2881e7a6-0099-4b87-819b-c36dd3db99c8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-109fe76b-a93e-4401-af1a-5c34271a87af req-5d594834-1d35-43f8-9db8-c8cf225d2b8b service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Received event network-vif-plugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-109fe76b-a93e-4401-af1a-5c34271a87af req-5d594834-1d35-43f8-9db8-c8cf225d2b8b service nova] Acquiring lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-109fe76b-a93e-4401-af1a-5c34271a87af req-5d594834-1d35-43f8-9db8-c8cf225d2b8b service nova] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-109fe76b-a93e-4401-af1a-5c34271a87af req-5d594834-1d35-43f8-9db8-c8cf225d2b8b service nova] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-109fe76b-a93e-4401-af1a-5c34271a87af req-5d594834-1d35-43f8-9db8-c8cf225d2b8b service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] No waiting events found dispatching network-vif-plugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:24 user nova-compute[73068]: WARNING nova.compute.manager [req-109fe76b-a93e-4401-af1a-5c34271a87af req-5d594834-1d35-43f8-9db8-c8cf225d2b8b service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Received unexpected event network-vif-plugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 for instance with vm_state building and task_state spawning.
Aug 26 11:39:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVeMdvyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:26 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:26 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:26 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[88016b6f-69b8-4ce9-a096-efe059e11455]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:39:26 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-6a3d1672-e597-43c0-99a5-e2db93b0a8e2 req-ccaaa789-4b82-4088-83b3-2bcc32a2945b service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Received event network-vif-plugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6a3d1672-e597-43c0-99a5-e2db93b0a8e2 req-ccaaa789-4b82-4088-83b3-2bcc32a2945b service nova] Acquiring lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6a3d1672-e597-43c0-99a5-e2db93b0a8e2 req-ccaaa789-4b82-4088-83b3-2bcc32a2945b service nova] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6a3d1672-e597-43c0-99a5-e2db93b0a8e2 req-ccaaa789-4b82-4088-83b3-2bcc32a2945b service nova] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-6a3d1672-e597-43c0-99a5-e2db93b0a8e2 req-ccaaa789-4b82-4088-83b3-2bcc32a2945b service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] No waiting events found dispatching network-vif-plugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:26 user nova-compute[73068]: WARNING nova.compute.manager [req-6a3d1672-e597-43c0-99a5-e2db93b0a8e2 req-ccaaa789-4b82-4088-83b3-2bcc32a2945b service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Received unexpected event network-vif-plugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 for instance with vm_state building and task_state spawning.
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac1064-beb7-406b-8344-d57d219fe538]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d] added
Aug 26 11:39:26 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cce55c3-1f0a-41d4-9bdf-aed2d65d23b7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b66a73-fddd-4bac-a34d-c6de329bd6c9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVeMdvyo {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LVeMdvyo" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[43de8a89-98df-4a73-beda-735113efc489]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LVeMdvyo'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c672e6ae-d053-48eb-9f2d-1bbf924fd098]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17e0337-5d2a-4438-a453-94d7c12bc69b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:26 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:26 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:26 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Acquiring lock "3c888403-0a31-4494-b822-73f42acadf00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "3c888403-0a31-4494-b822-73f42acadf00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Acquiring lock "3c888403-0a31-4494-b822-73f42acadf00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "3c888403-0a31-4494-b822-73f42acadf00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "3c888403-0a31-4494-b822-73f42acadf00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049967.0555508, 2881e7a6-0099-4b87-819b-c36dd3db99c8 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:39:27 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] VM Resumed (Lifecycle Event)
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --login" returned: 0 in 0.123s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3352cea-3b5e-475a-8e5d-e0a79ba20c9e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d, portal: 172.16.0.220,3260]
Aug 26 11:39:27 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:27 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:27 user nova-compute[73068]: INFO nova.compute.manager [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Terminating instance
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4323a44e-0c56-47a9-9c7f-6ef4bb34e55b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:39:27 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Instance spawned successfully.
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a338d1c-e128-4117-ab32-4dd23e49b654]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:27 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:27 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:27 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.523s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:39:27 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693049967.093378, 2881e7a6-0099-4b87-819b-c36dd3db99c8 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:39:27 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] VM Started (Lifecycle Event)
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e883ec9-b121-4658-9e67-99f678419721]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVeMdvyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:27 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:39:27 user nova-compute[73068]: INFO nova.compute.manager [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Took 8.35 seconds to spawn the instance on the hypervisor.
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:27 user nova-compute[73068]: INFO nova.compute.manager [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Took 9.84 seconds to build instance.
Aug 26 11:39:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-58d57850-3364-4aff-87d8-21722842bc1c tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.166s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-bcdb4c4e-9ad1-4526-8114-e24e2a9ee6c8 req-c1ef9955-f1b6-487a-9d11-e62258ebcedb service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Received event network-vif-unplugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bcdb4c4e-9ad1-4526-8114-e24e2a9ee6c8 req-c1ef9955-f1b6-487a-9d11-e62258ebcedb service nova] Acquiring lock "3c888403-0a31-4494-b822-73f42acadf00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bcdb4c4e-9ad1-4526-8114-e24e2a9ee6c8 req-c1ef9955-f1b6-487a-9d11-e62258ebcedb service nova] Lock "3c888403-0a31-4494-b822-73f42acadf00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bcdb4c4e-9ad1-4526-8114-e24e2a9ee6c8 req-c1ef9955-f1b6-487a-9d11-e62258ebcedb service nova] Lock "3c888403-0a31-4494-b822-73f42acadf00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-bcdb4c4e-9ad1-4526-8114-e24e2a9ee6c8 req-c1ef9955-f1b6-487a-9d11-e62258ebcedb service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] No waiting events found dispatching network-vif-unplugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-bcdb4c4e-9ad1-4526-8114-e24e2a9ee6c8 req-c1ef9955-f1b6-487a-9d11-e62258ebcedb service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Received event network-vif-unplugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:39:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:28 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Instance destroyed successfully.
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.objects.instance [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lazy-loading 'resources' on Instance uuid 3c888403-0a31-4494-b822-73f42acadf00 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-324139379',display_name='tempest-VolumesActionsTest-instance-324139379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-324139379',id=6,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f4da21f26d942eaa5f6eb075d268200',ramdisk_id='',reservation_id='r-9jm7w9j7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-673651622',owner_user_name='tempest-VolumesActionsTest-673651622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:37:33Z,user_data=None,user_id='f70c9635318145738d4edf74ab71b3fd',uuid=3c888403-0a31-4494-b822-73f42acadf00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "address": "fa:16:3e:11:40:3b", "network": {"id": "0ae58cc1-a529-47f5-a2de-3f1e2dcf2002", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1371283297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4da21f26d942eaa5f6eb075d268200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6d5120-5b", "ovs_interfaceid": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Converting VIF {"id": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "address": "fa:16:3e:11:40:3b", "network": {"id": "0ae58cc1-a529-47f5-a2de-3f1e2dcf2002", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1371283297-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f4da21f26d942eaa5f6eb075d268200", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e6d5120-5b", "ovs_interfaceid": "0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:40:3b,bridge_name='br-int',has_traffic_filtering=True,id=0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37,network=Network(0ae58cc1-a529-47f5-a2de-3f1e2dcf2002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6d5120-5b') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG os_vif [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:40:3b,bridge_name='br-int',has_traffic_filtering=True,id=0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37,network=Network(0ae58cc1-a529-47f5-a2de-3f1e2dcf2002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6d5120-5b') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e6d5120-5b, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:28 user nova-compute[73068]: INFO os_vif [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:40:3b,bridge_name='br-int',has_traffic_filtering=True,id=0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37,network=Network(0ae58cc1-a529-47f5-a2de-3f1e2dcf2002),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e6d5120-5b')
Aug 26 11:39:28 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Deleting instance files /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00_del
Aug 26 11:39:28 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Deletion of /opt/stack/data/nova/instances/3c888403-0a31-4494-b822-73f42acadf00_del complete
Aug 26 11:39:28 user nova-compute[73068]: INFO nova.compute.manager [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 26 11:39:28 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 3c888403-0a31-4494-b822-73f42acadf00] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.625s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] <== connect_volume: return (1628ms) {'type': 'block', 'scsi_wwn': '23563326266386535', 'path': '/dev/sdj'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563326266386535', 'path': '/dev/sdj'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.objects.instance [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lazy-loading 'flavor' on Instance uuid 85b6aa5b-72c1-415f-8552-19d0cd3859d6 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:39:28 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:28 user nova-compute[73068]:   <source dev="/dev/sdj"/>
Aug 26 11:39:28 user nova-compute[73068]:   <target dev="sdc" bus="scsi"/>
Aug 26 11:39:28 user nova-compute[73068]:   <serial>6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d</serial>
Aug 26 11:39:28 user nova-compute[73068]:   <address type="drive" controller="0" unit="2"/>
Aug 26 11:39:28 user nova-compute[73068]: </disk>
Aug 26 11:39:28 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] No BDM found with device name sda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] No VIF found with MAC fa:16:3e:2d:f2:7b, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bc0d179d-db0e-4c12-8419-51cc5eca5e57 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.635s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-3a06fa00-587d-425d-b76e-9eb5c1b9df2d req-e5e03bf1-6aaf-4a8b-9ab9-60febb71d138 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Received event network-changed-ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-3a06fa00-587d-425d-b76e-9eb5c1b9df2d req-e5e03bf1-6aaf-4a8b-9ab9-60febb71d138 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Refreshing instance network info cache due to event network-changed-ddc74644-b198-466a-8a7a-d9176c59f737. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3a06fa00-587d-425d-b76e-9eb5c1b9df2d req-e5e03bf1-6aaf-4a8b-9ab9-60febb71d138 service nova] Acquiring lock "refresh_cache-63ea93a3-9a33-42fd-af3a-686b848d0dc1" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3a06fa00-587d-425d-b76e-9eb5c1b9df2d req-e5e03bf1-6aaf-4a8b-9ab9-60febb71d138 service nova] Acquired lock "refresh_cache-63ea93a3-9a33-42fd-af3a-686b848d0dc1" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG nova.network.neutron [req-3a06fa00-587d-425d-b76e-9eb5c1b9df2d req-e5e03bf1-6aaf-4a8b-9ab9-60febb71d138 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Refreshing network info cache for port ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:29 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Took 1.24 seconds to deallocate network for instance.
Aug 26 11:39:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Acquiring lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG nova.objects.instance [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lazy-loading 'flavor' on Instance uuid 63ea93a3-9a33-42fd-af3a-686b848d0dc1 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.135s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-85e69877-9361-4432-a2f5-f6900870680b req-f227fc8c-c2e8-43dc-b2a3-7d236ae1dca0 service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Received event network-vif-plugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-85e69877-9361-4432-a2f5-f6900870680b req-f227fc8c-c2e8-43dc-b2a3-7d236ae1dca0 service nova] Acquiring lock "3c888403-0a31-4494-b822-73f42acadf00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-85e69877-9361-4432-a2f5-f6900870680b req-f227fc8c-c2e8-43dc-b2a3-7d236ae1dca0 service nova] Lock "3c888403-0a31-4494-b822-73f42acadf00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-85e69877-9361-4432-a2f5-f6900870680b req-f227fc8c-c2e8-43dc-b2a3-7d236ae1dca0 service nova] Lock "3c888403-0a31-4494-b822-73f42acadf00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-85e69877-9361-4432-a2f5-f6900870680b req-f227fc8c-c2e8-43dc-b2a3-7d236ae1dca0 service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] No waiting events found dispatching network-vif-plugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:29 user nova-compute[73068]: WARNING nova.compute.manager [req-85e69877-9361-4432-a2f5-f6900870680b req-f227fc8c-c2e8-43dc-b2a3-7d236ae1dca0 service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Received unexpected event network-vif-plugged-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 for instance with vm_state deleted and task_state None.
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Acquiring lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:30 user nova-compute[73068]: INFO nova.compute.manager [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Attaching volume 4f626576-8085-4aaf-ba1e-ab60ea533ccf to /dev/vdb
Aug 26 11:39:30 user nova-compute[73068]: DEBUG nova.network.neutron [req-3a06fa00-587d-425d-b76e-9eb5c1b9df2d req-e5e03bf1-6aaf-4a8b-9ab9-60febb71d138 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Updated VIF entry in instance network info cache for port ddc74644-b198-466a-8a7a-d9176c59f737. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG nova.network.neutron [req-3a06fa00-587d-425d-b76e-9eb5c1b9df2d req-e5e03bf1-6aaf-4a8b-9ab9-60febb71d138 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Updating instance_info_cache with network_info: [{"id": "ddc74644-b198-466a-8a7a-d9176c59f737", "address": "fa:16:3e:04:90:d1", "network": {"id": "a1c559c7-3c86-48bb-b5ad-fe7637d00998", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2071799706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a44dcfea3443b3b08867640a2de1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc74644-b1", "ovs_interfaceid": "ddc74644-b198-466a-8a7a-d9176c59f737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3a06fa00-587d-425d-b76e-9eb5c1b9df2d req-e5e03bf1-6aaf-4a8b-9ab9-60febb71d138 service nova] Releasing lock "refresh_cache-63ea93a3-9a33-42fd-af3a-686b848d0dc1" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG os_brick.utils [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c068e18-37ef-49ba-b7ea-630cd73745a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2352fc64-cf2f-4f9c-baa8-7ccf616b5ba4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.753s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f36f0b-6987-46f8-b210-7a07885c567e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[582a69eb-e824-4591-943c-48c7fa8d01f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:39:30 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Deleted allocations for instance 3c888403-0a31-4494-b822-73f42acadf00
Aug 26 11:39:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:39:30 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec11ecfd-76b3-4850-ba2c-5c749435c217]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG os_brick.utils [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Updating existing volume attachment record: 708aae8d-41a9-4d1f-983b-d30c551a336c {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:39:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-75f944c7-10ce-4537-a5d6-fb0e54e5d87b tempest-VolumesActionsTest-673651622 tempest-VolumesActionsTest-673651622-project-member] Lock "3c888403-0a31-4494-b822-73f42acadf00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.682s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-468b9d8b-0c81-45f0-a9ed-8290e1216e5a req-1ac3e021-ad02-400a-a413-8830fae39e7e service nova] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Received event network-vif-deleted-0e6d5120-5bb0-477d-bfdf-94e6dd3f9a37 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZmfNldh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:32 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:32 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:32 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a7a246-bbb8-44fa-9ca6-0b50d9ab8df9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:39:32 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e65f4a9-373a-4a1e-b9bc-524d7db500ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30] added
Aug 26 11:39:32 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee08a230-7122-4c09-8e4a-edb72c77af89]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[807ca5de-5149-45d7-9da3-9490302cbcb6]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yZmfNldh {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yZmfNldh" returned: 0 in 0.033s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a202e474-16ee-48b5-aea3-70c539aa2b79]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yZmfNldh'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[733a4e4a-c270-4a8d-8620-4b4088d55c06]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[562d1872-4eb8-4a13-aae3-39131f0da62a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:32 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:32 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:32 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:33 user nova-compute[73068]: INFO nova.compute.manager [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Detaching volume 6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8835e4dd-d92a-4ad4-a810-9e056eebcca9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30, portal: 172.16.0.220,3260]
Aug 26 11:39:33 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:33 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a22b028-0a48-445a-9d7b-bda8adb68570]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[026e8c05-bf0c-4a98-b6f0-f31bad4f70af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:33 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:33 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:33 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.444s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:39:33 user nova-compute[73068]: INFO nova.virt.block_device [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Attempting to driver detach volume 6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d from mountpoint /dev/sdc
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccedf6f6-c62d-4c0b-8992-6db69afdc31c]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZmfNldh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Attempting to detach device sdc from instance 85b6aa5b-72c1-415f-8552-19d0cd3859d6 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:39:33 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:33 user nova-compute[73068]:   <source dev="/dev/sdj"/>
Aug 26 11:39:33 user nova-compute[73068]:   <target dev="sdc" bus="scsi"/>
Aug 26 11:39:33 user nova-compute[73068]:   <serial>6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d</serial>
Aug 26 11:39:33 user nova-compute[73068]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 11:39:33 user nova-compute[73068]: </disk>
Aug 26 11:39:33 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:39:33 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Successfully detached device sdc from instance 85b6aa5b-72c1-415f-8552-19d0cd3859d6 from the persistent domain config.
Aug 26 11:39:33 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 85b6aa5b-72c1-415f-8552-19d0cd3859d6 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:39:33 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:33 user nova-compute[73068]:   <source dev="/dev/sdj"/>
Aug 26 11:39:33 user nova-compute[73068]:   <target dev="sdc" bus="scsi"/>
Aug 26 11:39:33 user nova-compute[73068]:   <serial>6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d</serial>
Aug 26 11:39:33 user nova-compute[73068]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 11:39:33 user nova-compute[73068]: </disk>
Aug 26 11:39:33 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693049973.700853, 85b6aa5b-72c1-415f-8552-19d0cd3859d6 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 85b6aa5b-72c1-415f-8552-19d0cd3859d6 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:39:33 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Successfully detached device sdc from instance 85b6aa5b-72c1-415f-8552-19d0cd3859d6 from the live domain config.
Aug 26 11:39:33 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LVeMdvyo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:33 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] <== connect_volume: return (1497ms) {'type': 'block', 'scsi_wwn': '26333386138343834', 'path': '/dev/sdk'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333386138343834', 'path': '/dev/sdk'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.507s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG nova.objects.instance [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lazy-loading 'flavor' on Instance uuid 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7632021-fad1-4d2e-a196-b857033b6b26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[775ed7c4-3b54-4a88-a19e-fd811f4b3e92]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:34 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:34 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:34 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb0379bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d'): ({'sdj'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Removing single pathed devices sdj {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:39:34 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:34 user nova-compute[73068]:   <source dev="/dev/sdk"/>
Aug 26 11:39:34 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:39:34 user nova-compute[73068]:   <serial>f4b68aa5-4d76-457c-a569-6b1b9484ef30</serial>
Aug 26 11:39:34 user nova-compute[73068]: </disk>
Aug 26 11:39:34 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbb9d91-1190-4ac3-879e-1a98bf49c34c]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fb9566-d4a5-4a5f-9dc4-fa22104150bc]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Flushing IO for device /dev/sdj {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63c1e9d-520a-4c68-a726-89d52b74ef21]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.042s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[21017ecd-1898-4d0e-a6b5-5d3366d22537]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] SCSI volumes sdj have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a30fbe-70ca-4923-b178-aa0dc9051157]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9b8b6b-dc65-4346-9887-28e956e0298c]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d, portal: 172.16.0.220,3260]
Aug 26 11:39:34 user nova-compute[73068]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:34 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ebaa1a3-b4e1-469b-8ce2-8772d46ef37d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e31387-50c7-4827-89b0-ca280107df02]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] <== disconnect_volume: return (881ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] No VIF found with MAC fa:16:3e:7f:de:1f, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXJNwHpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:35 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:35 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:35 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[193e926b-47e0-4c07-941d-5e702c5f00ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:39:35 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[664a1531-34fb-46fe-96e1-24292666c1e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545] added
Aug 26 11:39:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb91866-e2e7-4ce7-af5b-42549c735cc9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-699ccfe7-5f9a-4179-958d-6811615fff04 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.083s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3fab88-50cc-4eb4-bf9f-b8b09d31e957]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cXJNwHpY {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cXJNwHpY" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3356c52-8882-45e1-b993-bc8aabaca921]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cXJNwHpY'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.070s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54417c1-0c77-49df-9e4d-cbd6025fec46]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG nova.objects.instance [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lazy-loading 'flavor' on Instance uuid 85b6aa5b-72c1-415f-8552-19d0cd3859d6 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.154s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[510c313a-48f7-4a08-9518-d9735a03ad1c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-050549e2-23da-4775-bd74-fccee2edc36d tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.681s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --login" returned: 0 in 0.158s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bd601d-819a-4fc3-8ae0-3b513a925332]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545, portal: 172.16.0.220,3260]
Aug 26 11:39:35 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f014be-f49c-4b0d-990e-861b7b3c32e8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[191995a0-05f4-4c2f-9cb9-41d1a55de300]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:35 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.662s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.042s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5daf9c-584b-4f90-b42d-87530c55d81e]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:39:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXJNwHpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:39:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:36 user nova-compute[73068]: INFO nova.compute.manager [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Detaching volume f4b68aa5-4d76-457c-a569-6b1b9484ef30
Aug 26 11:39:36 user nova-compute[73068]: INFO nova.virt.block_device [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Attempting to driver detach volume f4b68aa5-4d76-457c-a569-6b1b9484ef30 from mountpoint /dev/vdb
Aug 26 11:39:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Attempting to detach device vdb from instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:39:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:39:36 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:36 user nova-compute[73068]:   <source dev="/dev/sdk"/>
Aug 26 11:39:36 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:39:36 user nova-compute[73068]:   <serial>f4b68aa5-4d76-457c-a569-6b1b9484ef30</serial>
Aug 26 11:39:36 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:39:36 user nova-compute[73068]: </disk>
Aug 26 11:39:36 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:39:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Successfully detached device vdb from instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 from the persistent domain config.
Aug 26 11:39:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:39:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:39:36 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:36 user nova-compute[73068]:   <source dev="/dev/sdk"/>
Aug 26 11:39:36 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:39:36 user nova-compute[73068]:   <serial>f4b68aa5-4d76-457c-a569-6b1b9484ef30</serial>
Aug 26 11:39:36 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:39:36 user nova-compute[73068]: </disk>
Aug 26 11:39:36 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:39:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.727s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] <== connect_volume: return (1728ms) {'type': 'block', 'scsi_wwn': '26636663939656535', 'path': '/dev/sdj'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636663939656535', 'path': '/dev/sdj'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:39:36 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lazy-loading 'flavor' on Instance uuid 792b5efb-63fa-4e87-b114-61de6180b2c6 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:39:37 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:37 user nova-compute[73068]:   <source dev="/dev/sdj"/>
Aug 26 11:39:37 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:39:37 user nova-compute[73068]:   <serial>7c19634f-40b5-4e36-be22-372a0447f545</serial>
Aug 26 11:39:37 user nova-compute[73068]: </disk>
Aug 26 11:39:37 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:37 user nova-compute[73068]: INFO nova.compute.manager [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Terminating instance
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693049977.1663637, 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:39:37 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Successfully detached device vdb from instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 from the live domain config.
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZmfNldh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:37 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[66953775-3a07-44c2-bd7c-e1a9fa8eadf9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c18abfa-ea79-4327-a670-3d241a6ca9e8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:37 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb0571510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30'): ({'sdk'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Removing single pathed devices sdk {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[69483b9d-e80f-4fba-b03e-d4c8b0090f1f]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7420d97d-dc47-4caf-ad66-58f0caef1ea2]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Flushing IO for device /dev/sdk {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffe42f1-e056-442c-bde2-afacc7cf2267]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.045s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8365c4b4-06a2-4769-b72a-0a1961c86fe9]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] SCSI volumes sdk have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a802f1df-1bda-45fc-b9a9-1e9617c03ab7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-7c60c599-045c-4740-a25f-c89dd4fb3924 req-eb6d68bf-2732-47f5-8918-9e6f9009bf09 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Received event network-vif-unplugged-b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c60c599-045c-4740-a25f-c89dd4fb3924 req-eb6d68bf-2732-47f5-8918-9e6f9009bf09 service nova] Acquiring lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c60c599-045c-4740-a25f-c89dd4fb3924 req-eb6d68bf-2732-47f5-8918-9e6f9009bf09 service nova] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c60c599-045c-4740-a25f-c89dd4fb3924 req-eb6d68bf-2732-47f5-8918-9e6f9009bf09 service nova] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-7c60c599-045c-4740-a25f-c89dd4fb3924 req-eb6d68bf-2732-47f5-8918-9e6f9009bf09 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] No waiting events found dispatching network-vif-unplugged-b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-7c60c599-045c-4740-a25f-c89dd4fb3924 req-eb6d68bf-2732-47f5-8918-9e6f9009bf09 service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Received event network-vif-unplugged-b2bf177e-b82e-48bd-9f92-9084b2339918 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b604b8b-8f6b-4d6a-a5db-dd495b468d04]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30, portal: 172.16.0.220,3260]
Aug 26 11:39:37 user nova-compute[73068]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4b68aa5-4d76-457c-a569-6b1b9484ef30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f7097f-9264-4e89-bf7e-e65d4d2b56fd]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] <== disconnect_volume: return (412ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] No VIF found with MAC fa:16:3e:2b:19:db, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:39:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d7d76e84-365e-487e-ba6f-20c52fa6e7df tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.578s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Instance destroyed successfully.
Aug 26 11:39:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lazy-loading 'resources' on Instance uuid 85b6aa5b-72c1-415f-8552-19d0cd3859d6 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1558244493',display_name='tempest-AttachSCSIVolumeTestJSON-server-1558244493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1558244493',id=4,image_ref='51dab0fa-ab90-4432-ab1d-6fdb8917085c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyUw+qufbQqUWoz/CiBmupIl2yOijhsEE9Tdzo8niAVnb+dwXzplAP2SA4EbWgspXBQc6Xp1sjBnmC0VPbaE/c1rxFovb+K6adl63cDyCTF1uK/l0j6soBsDxEkcJnf9w==',key_name='tempest-keypair-499677598',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a0444942992475b91cb620febed557a',ramdisk_id='',reservation_id='r-k1sycq81',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51dab0fa-ab90-4432-ab1d-6fdb8917085c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-779650499',owner_user_name='tempest-AttachSCSIVolumeTestJSON-779650499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82abb02eedf84095a66a8ef23dd5d0e6',uuid=85b6aa5b-72c1-415f-8552-19d0cd3859d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2bf177e-b82e-48bd-9f92-9084b2339918", "address": "fa:16:3e:2d:f2:7b", "network": {"id": "2bb55e61-9a1b-424a-950c-ef73a9e48345", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772847370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0444942992475b91cb620febed557a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bf177e-b8", "ovs_interfaceid": "b2bf177e-b82e-48bd-9f92-9084b2339918", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Converting VIF {"id": "b2bf177e-b82e-48bd-9f92-9084b2339918", "address": "fa:16:3e:2d:f2:7b", "network": {"id": "2bb55e61-9a1b-424a-950c-ef73a9e48345", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1772847370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a0444942992475b91cb620febed557a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2bf177e-b8", "ovs_interfaceid": "b2bf177e-b82e-48bd-9f92-9084b2339918", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:7b,bridge_name='br-int',has_traffic_filtering=True,id=b2bf177e-b82e-48bd-9f92-9084b2339918,network=Network(2bb55e61-9a1b-424a-950c-ef73a9e48345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bf177e-b8') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG os_vif [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:7b,bridge_name='br-int',has_traffic_filtering=True,id=b2bf177e-b82e-48bd-9f92-9084b2339918,network=Network(2bb55e61-9a1b-424a-950c-ef73a9e48345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bf177e-b8') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2bf177e-b8, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:38 user nova-compute[73068]: INFO os_vif [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:f2:7b,bridge_name='br-int',has_traffic_filtering=True,id=b2bf177e-b82e-48bd-9f92-9084b2339918,network=Network(2bb55e61-9a1b-424a-950c-ef73a9e48345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2bf177e-b8')
Aug 26 11:39:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Deleting instance files /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6_del
Aug 26 11:39:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Deletion of /opt/stack/data/nova/instances/85b6aa5b-72c1-415f-8552-19d0cd3859d6_del complete
Aug 26 11:39:38 user nova-compute[73068]: INFO nova.compute.manager [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 26 11:39:38 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lazy-loading 'flavor' on Instance uuid 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3233af28-3431-4763-bcc7-dbe726a55175 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.260s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-54163f80-78d1-4e81-a77f-23e3bf0e51a1 req-009896fc-b8c9-4547-abbe-fadcbdb6072c service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-changed-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-54163f80-78d1-4e81-a77f-23e3bf0e51a1 req-009896fc-b8c9-4547-abbe-fadcbdb6072c service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Refreshing instance network info cache due to event network-changed-2000fb73-9c36-4d66-802c-4e5b0aa88226. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-54163f80-78d1-4e81-a77f-23e3bf0e51a1 req-009896fc-b8c9-4547-abbe-fadcbdb6072c service nova] Acquiring lock "refresh_cache-8a96b57f-dd74-45b8-aa23-a6187dc4bb93" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-54163f80-78d1-4e81-a77f-23e3bf0e51a1 req-009896fc-b8c9-4547-abbe-fadcbdb6072c service nova] Acquired lock "refresh_cache-8a96b57f-dd74-45b8-aa23-a6187dc4bb93" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:39:38 user nova-compute[73068]: DEBUG nova.network.neutron [req-54163f80-78d1-4e81-a77f-23e3bf0e51a1 req-009896fc-b8c9-4547-abbe-fadcbdb6072c service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Refreshing network info cache for port 2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] Acquiring lock "792b5efb-63fa-4e87-b114-61de6180b2c6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG os_brick.utils [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0629e1a3-b207-4a0e-bc8e-243cf7681f92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25359e8-1904-4b22-ac8f-b662158b82f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fdb6e1-a70c-4a44-84ea-640f2817a306]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee290985-6ec7-4533-b4cc-dc2fc15e899c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:39:39 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1213f02b-2ec5-4d0c-aabd-f0387b343a0c]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG os_brick.utils [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-74edf8a0-3bd6-4d57-bfc1-1177d80be06f req-597674a8-acc7-4a09-bde6-d68ebbcfe0ba service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Received event network-vif-plugged-b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-74edf8a0-3bd6-4d57-bfc1-1177d80be06f req-597674a8-acc7-4a09-bde6-d68ebbcfe0ba service nova] Acquiring lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-74edf8a0-3bd6-4d57-bfc1-1177d80be06f req-597674a8-acc7-4a09-bde6-d68ebbcfe0ba service nova] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-74edf8a0-3bd6-4d57-bfc1-1177d80be06f req-597674a8-acc7-4a09-bde6-d68ebbcfe0ba service nova] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-74edf8a0-3bd6-4d57-bfc1-1177d80be06f req-597674a8-acc7-4a09-bde6-d68ebbcfe0ba service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] No waiting events found dispatching network-vif-plugged-b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:39 user nova-compute[73068]: WARNING nova.compute.manager [req-74edf8a0-3bd6-4d57-bfc1-1177d80be06f req-597674a8-acc7-4a09-bde6-d68ebbcfe0ba service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Received unexpected event network-vif-plugged-b2bf177e-b82e-48bd-9f92-9084b2339918 for instance with vm_state active and task_state deleting.
Aug 26 11:39:39 user nova-compute[73068]: INFO nova.compute.manager [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Swapping volume 7c19634f-40b5-4e36-be22-372a0447f545 for 474378e1-a947-47b0-805b-801f5957c785
Aug 26 11:39:39 user nova-compute[73068]: DEBUG nova.network.neutron [req-54163f80-78d1-4e81-a77f-23e3bf0e51a1 req-009896fc-b8c9-4547-abbe-fadcbdb6072c service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Updated VIF entry in instance network info cache for port 2000fb73-9c36-4d66-802c-4e5b0aa88226. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG nova.network.neutron [req-54163f80-78d1-4e81-a77f-23e3bf0e51a1 req-009896fc-b8c9-4547-abbe-fadcbdb6072c service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Updating instance_info_cache with network_info: [{"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-54163f80-78d1-4e81-a77f-23e3bf0e51a1 req-009896fc-b8c9-4547-abbe-fadcbdb6072c service nova] Releasing lock "refresh_cache-8a96b57f-dd74-45b8-aa23-a6187dc4bb93" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:39:39 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:39 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Took 1.83 seconds to deallocate network for instance.
Aug 26 11:39:40 user nova-compute[73068]: INFO nova.compute.manager [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Rebuilding instance
Aug 26 11:39:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.808s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:40 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Deleted allocations for instance 85b6aa5b-72c1-415f-8552-19d0cd3859d6
Aug 26 11:39:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-09a75937-3964-4df2-beb1-40ebb93938cf req-c7743086-c789-4805-8cf7-cd142f3c158a service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-vif-unplugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-09a75937-3964-4df2-beb1-40ebb93938cf req-c7743086-c789-4805-8cf7-cd142f3c158a service nova] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-09a75937-3964-4df2-beb1-40ebb93938cf req-c7743086-c789-4805-8cf7-cd142f3c158a service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-09a75937-3964-4df2-beb1-40ebb93938cf req-c7743086-c789-4805-8cf7-cd142f3c158a service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-09a75937-3964-4df2-beb1-40ebb93938cf req-c7743086-c789-4805-8cf7-cd142f3c158a service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] No waiting events found dispatching network-vif-unplugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:40 user nova-compute[73068]: WARNING nova.compute.manager [req-09a75937-3964-4df2-beb1-40ebb93938cf req-c7743086-c789-4805-8cf7-cd142f3c158a service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received unexpected event network-vif-unplugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 for instance with vm_state active and task_state rebuilding.
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-124a02a4-34a7-43ae-b25a-d6d6712c4542 tempest-AttachSCSIVolumeTestJSON-779650499 tempest-AttachSCSIVolumeTestJSON-779650499-project-member] Lock "85b6aa5b-72c1-415f-8552-19d0cd3859d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.930s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:41 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Instance destroyed successfully.
Aug 26 11:39:41 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Instance destroyed successfully.
Aug 26 11:39:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-772664691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-800782579',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/ZA4n0oqdwxudhPdUfBqQgXyjpwc/T+oPc5U+vqaCyvzEcT70JQD8EejyFZzqJOf+nGQXLZHuQHaE86x94DM7IeG2QP7b5azKYS86x18eGLwCVUieLMNu0xFns9T2eA==',key_name='tempest-keypair-1654929932',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:38:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6d54004525be4f06a7f9c1dc86ec3248',ramdisk_id='',reservation_id='r-5ar52vv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1026667147',owner_user_name='tempest-ServerActionsV293TestJSON-1026667147-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:39:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bd5b5460f15416c8b7851b85fe3da30',uuid=8a96b57f-dd74-45b8-aa23-a6187dc4bb93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converting VIF {"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_vif [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2000fb73-9c, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:39:41 user nova-compute[73068]: INFO os_vif [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c')
Aug 26 11:39:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFyOtqMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:41 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9099da3-96ad-4600-8d3c-f3c62b0f9768]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd10bbf5-9392-4c86-95e4-d228dbc43b39]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:41 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:41 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb0197d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69f12f3-862f-4da7-99ce-693e1c17979c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2263ece4-ab75-4119-b528-9a58976c2f70]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b469083f-a916-47bb-bddc-9995c1dfdddd]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[184ac9a3-4a95-4f7c-88e1-5ba41070931b]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcab7de6-ec4a-4f6f-b6ad-726c11854948]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24f9fb7-e8be-4f0d-a7b9-5681a732b6a9]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260]
Aug 26 11:39:41 user nova-compute[73068]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:41 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec0f586-86a3-4c86-9aee-e519e5de3713]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] <== disconnect_volume: return (375ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:39:41 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Deleting instance files /opt/stack/data/nova/instances/8a96b57f-dd74-45b8-aa23-a6187dc4bb93_del
Aug 26 11:39:41 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Deletion of /opt/stack/data/nova/instances/8a96b57f-dd74-45b8-aa23-a6187dc4bb93_del complete
Aug 26 11:39:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-159d7f5c-3bd8-438f-a0ac-7dd320e08d0a req-3507389f-bee4-46af-9cc7-65dbad32922e service nova] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Received event network-vif-deleted-b2bf177e-b82e-48bd-9f92-9084b2339918 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:41 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 could not be found.
Aug 26 11:39:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFyOtqMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:41 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e007d65d-a223-4be0-a160-302c6e6358f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a3c8c3-9d91-4223-993d-a654d36e95d2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:41 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:41 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:41 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddbf7e5e10>, {}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Disconnecting from: [] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] <== disconnect_volume: return (64ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:39:42 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693049967.9876199, 3c888403-0a31-4494-b822-73f42acadf00 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:39:42 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 3c888403-0a31-4494-b822-73f42acadf00] VM Stopped (Lifecycle Event)
Aug 26 11:39:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-159314b1-a79c-4f90-ac66-4e41a21e55ea req-1aebf575-115a-4cff-9eb8-7257d78593b4 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:39:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-159314b1-a79c-4f90-ac66-4e41a21e55ea req-1aebf575-115a-4cff-9eb8-7257d78593b4 service nova] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-159314b1-a79c-4f90-ac66-4e41a21e55ea req-1aebf575-115a-4cff-9eb8-7257d78593b4 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-159314b1-a79c-4f90-ac66-4e41a21e55ea req-1aebf575-115a-4cff-9eb8-7257d78593b4 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-159314b1-a79c-4f90-ac66-4e41a21e55ea req-1aebf575-115a-4cff-9eb8-7257d78593b4 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] No waiting events found dispatching network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:39:43 user nova-compute[73068]: WARNING nova.compute.manager [req-159314b1-a79c-4f90-ac66-4e41a21e55ea req-1aebf575-115a-4cff-9eb8-7257d78593b4 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received unexpected event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 for instance with vm_state active and task_state rebuilding.
Aug 26 11:39:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6763c6d1-15ef-4260-b3dc-65a0d4cd238c None None] [instance: 3c888403-0a31-4494-b822-73f42acadf00] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:39:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxbAiDcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:45 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:45 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:45 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:39:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9122578-97fc-42aa-949c-23b5d03ed669]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:39:46 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2068277-525b-4801-9c7e-6c94faf1f427]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf] added
Aug 26 11:39:46 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9780e0-bc4d-4dfd-977c-ac7d978c6294]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[62219ab3-f9e9-433a-8c04-4b66b2004b6b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dxbAiDcj {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dxbAiDcj" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[752d084a-55dd-482b-9ef7-37b5eb2bc2ac]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dxbAiDcj'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0fcf41-190f-4f1a-9537-1a587c93a0c8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0d3302-1fce-402c-8443-68166e09152a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:46 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:46 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --login" returned: 0 in 0.165s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d68af8-47ac-4362-bf8d-e7db96781985]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf, portal: 172.16.0.220,3260]
Aug 26 11:39:46 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:46 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[027bb9d6-0f36-4032-81b6-6ba194fa0c0e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[389a1585-84dd-4b33-a8f2-9318f2808fab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:46 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:46 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:46 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4ff5b5-1293-48d4-869b-5745271ad264]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxbAiDcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Preparing to wait for external event volume-reimaged-d6769dd3-49e3-48fc-8c4f-907a17b55517 {{(pid=73068) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.volume.cinder [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] Update attachment failed for attachment 94d3203c-7d63-4445-b8b5-80e65f42aaa2. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 was not found.).). (HTTP 500) (Request-ID: req-cdb9a7cd-78a4-4934-8a04-ccfe9bfd8ce4) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 was not found.).). (HTTP 500) (Request-ID: req-cdb9a7cd-78a4-4934-8a04-ccfe9bfd8ce4)
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Failed to connect to volume 474378e1-a947-47b0-805b-801f5957c785 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 was not found.).). (HTTP 500) (Request-ID: req-cdb9a7cd-78a4-4934-8a04-ccfe9bfd8ce4)
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Traceback (most recent call last):
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     new_cinfo = self.volume_api.attachment_update(
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     res = method(self, ctx, *args, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     with excutils.save_and_reraise_exception():
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     self.force_reraise()
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     raise self.value
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     return method.func(obj, *args, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     resp = self._update('/attachments/%s' % id, body)
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     return self.request(url, method, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6]     raise exceptions.from_response(resp, body)
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 was not found.).). (HTTP 500) (Request-ID: req-cdb9a7cd-78a4-4934-8a04-ccfe9bfd8ce4)
Aug 26 11:39:46 user nova-compute[73068]: ERROR nova.compute.manager [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] 
Aug 26 11:39:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 7.504s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server [None req-5f891dfe-391e-4827-bd30-7088df942043 tempest-TestVolumeSwap-1688570350 tempest-TestVolumeSwap-1688570350-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 was not found.).). (HTTP 500) (Request-ID: req-cdb9a7cd-78a4-4934-8a04-ccfe9bfd8ce4)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7823, in swap_volume
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7821, in _do_locked_swap_volume
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7865, in _do_swap_volume
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7714, in _swap_volume
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7690, in _swap_volume
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7663, in _init_volume_connection
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:474378e1-a947-47b0-805b-801f5957c785/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 was not found.).). (HTTP 500) (Request-ID: req-cdb9a7cd-78a4-4934-8a04-ccfe9bfd8ce4)
Aug 26 11:39:46 user nova-compute[73068]: ERROR oslo_messaging.rpc.server 
Aug 26 11:39:47 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:47 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '23835356362666431', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835356362666431', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:39:47 user nova-compute[73068]: DEBUG nova.objects.instance [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lazy-loading 'flavor' on Instance uuid 63ea93a3-9a33-42fd-af3a-686b848d0dc1 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] attach device xml: <disk type="block" device="disk">
Aug 26 11:39:47 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:47 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:39:47 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:39:47 user nova-compute[73068]:   <serial>4f626576-8085-4aaf-ba1e-ab60ea533ccf</serial>
Aug 26 11:39:47 user nova-compute[73068]: </disk>
Aug 26 11:39:47 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:39:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:39:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] No VIF found with MAC fa:16:3e:04:90:d1, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:39:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bebe5623-3804-47b3-a961-bd9705d79fbe tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.935s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-010774b4-5cc6-4cea-bdee-d8f0075a137b tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] volume_snapshot_create: create_info: {'snapshot_id': 'ca9345ae-5dd0-4701-9eba-c72d7c7f8c7d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73068) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 26 11:39:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-010774b4-5cc6-4cea-bdee-d8f0075a137b tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] snap xml: <domainsnapshot>
Aug 26 11:39:48 user nova-compute[73068]:   <disks>
Aug 26 11:39:48 user nova-compute[73068]:     <disk name="/dev/sdb" snapshot="external" type="file">
Aug 26 11:39:48 user nova-compute[73068]:       <source file="/dev/new_file"/>
Aug 26 11:39:48 user nova-compute[73068]:     </disk>
Aug 26 11:39:48 user nova-compute[73068]:     <disk name="vda" snapshot="no"/>
Aug 26 11:39:48 user nova-compute[73068]:   </disks>
Aug 26 11:39:48 user nova-compute[73068]: </domainsnapshot>
Aug 26 11:39:48 user nova-compute[73068]:  {{(pid=73068) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 26 11:39:48 user nova-compute[73068]: DEBUG nova.objects.instance [None req-010774b4-5cc6-4cea-bdee-d8f0075a137b tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] Lazy-loading 'system_metadata' on Instance uuid 63ea93a3-9a33-42fd-af3a-686b848d0dc1 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-010774b4-5cc6-4cea-bdee-d8f0075a137b tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [None req-010774b4-5cc6-4cea-bdee-d8f0075a137b tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Traceback (most recent call last):
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     rv = execute(f, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     six.reraise(c, e, tb)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     raise value
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     rv = meth(*args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] 
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [None req-010774b4-5cc6-4cea-bdee-d8f0075a137b tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Traceback (most recent call last):
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     self._volume_snapshot_create(context, instance, guest,
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     rv = execute(f, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     six.reraise(c, e, tb)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     raise value
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     rv = meth(*args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] 
Aug 26 11:39:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a53d603d-de38-40b0-a271-94ca3c78a6fc tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] volume_snapshot_delete: delete_info: {'volume_id': '4f626576-8085-4aaf-ba1e-ab60ea533ccf'} {{(pid=73068) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [None req-a53d603d-de38-40b0-a271-94ca3c78a6fc tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Traceback (most recent call last):
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1]     if delete_info['type'] != 'qcow2':
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] KeyError: 'type'
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] 
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [None req-010774b4-5cc6-4cea-bdee-d8f0075a137b tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot ca9345ae-5dd0-4701-9eba-c72d7c7f8c7d could not be found.
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     raise value
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver 
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver 
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot ca9345ae-5dd0-4701-9eba-c72d7c7f8c7d could not be found. (HTTP 404) (Request-ID: req-3a8548d5-ab95-4e2e-97db-a388215a3f7e)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver 
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver 
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot ca9345ae-5dd0-4701-9eba-c72d7c7f8c7d could not be found.
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver 
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server [None req-010774b4-5cc6-4cea-bdee-d8f0075a137b tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise value
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server 
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver [None req-a53d603d-de38-40b0-a271-94ca3c78a6fc tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver 
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver 
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-fbd0bf2e-a483-48bd-b0ea-ba7c0be0ae0c)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver 
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver 
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 11:39:48 user nova-compute[73068]: ERROR nova.virt.libvirt.driver 
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server [None req-a53d603d-de38-40b0-a271-94ca3c78a6fc tempest-VolumesAssistedSnapshotsTest-601572089 tempest-VolumesAssistedSnapshotsTest-601572089-project] Exception during message handling: KeyError: 'type'
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 26 11:39:48 user nova-compute[73068]: ERROR oslo_messaging.rpc.server 
Aug 26 11:39:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Acquiring lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:48 user nova-compute[73068]: INFO nova.compute.manager [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Detaching volume 4f626576-8085-4aaf-ba1e-ab60ea533ccf
Aug 26 11:39:48 user nova-compute[73068]: INFO nova.virt.block_device [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Attempting to driver detach volume 4f626576-8085-4aaf-ba1e-ab60ea533ccf from mountpoint /dev/vdb
Aug 26 11:39:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Attempting to detach device vdb from instance 63ea93a3-9a33-42fd-af3a-686b848d0dc1 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:39:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 11:39:48 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:48 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:39:48 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:39:48 user nova-compute[73068]:   <serial>4f626576-8085-4aaf-ba1e-ab60ea533ccf</serial>
Aug 26 11:39:48 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:39:48 user nova-compute[73068]: </disk>
Aug 26 11:39:48 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:39:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Successfully detached device vdb from instance 63ea93a3-9a33-42fd-af3a-686b848d0dc1 from the persistent domain config.
Aug 26 11:39:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63ea93a3-9a33-42fd-af3a-686b848d0dc1 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:39:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 11:39:48 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:39:48 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:39:48 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:39:48 user nova-compute[73068]:   <serial>4f626576-8085-4aaf-ba1e-ab60ea533ccf</serial>
Aug 26 11:39:48 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:39:48 user nova-compute[73068]: </disk>
Aug 26 11:39:48 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693049989.3660812, 63ea93a3-9a33-42fd-af3a-686b848d0dc1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63ea93a3-9a33-42fd-af3a-686b848d0dc1 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:39:49 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Successfully detached device vdb from instance 63ea93a3-9a33-42fd-af3a-686b848d0dc1 from the live domain config.
Aug 26 11:39:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dxbAiDcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:39:49 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c84085b-1b5a-47f9-8d7f-64c39425bdc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[73234566-7ad8-4a0f-ae5b-fd5641bd49d1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:49 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:39:49 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:39:49 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd905beef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8307f9-dff7-44db-8253-2d6366299d86]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4df21c3-bc16-4453-bbe0-6bf5c263d6b5]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02a6d76-6a81-4c96-99de-07d265d2e1fa]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.075s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[805062ef-b123-4b17-8c8a-64cf63f6331f]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating instance_info_cache with network_info: [{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1a7385-1bcd-46aa-97df-10cd51779a6a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f21be08-00ff-4ea0-9f79-fdd167886ac7]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf, portal: 172.16.0.220,3260]
Aug 26 11:39:49 user nova-compute[73068]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf, portal: 172.16.0.220,3260] successful.
Aug 26 11:39:49 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f626576-8085-4aaf-ba1e-ab60ea533ccf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ba7083-b39b-4f28-ad6b-0a8132e97304]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] <== disconnect_volume: return (370ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:39:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG nova.objects.instance [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lazy-loading 'flavor' on Instance uuid 63ea93a3-9a33-42fd-af3a-686b848d0dc1 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4d0d1d29-633a-48a6-9bab-77dc77e65da2 tempest-VolumesAssistedSnapshotsTest-1205790598 tempest-VolumesAssistedSnapshotsTest-1205790598-project-admin] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.053s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:39:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:53 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693049978.0496507, 85b6aa5b-72c1-415f-8552-19d0cd3859d6 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:39:53 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] VM Stopped (Lifecycle Event)
Aug 26 11:39:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:53 user nova-compute[73068]: DEBUG nova.compute.manager [None req-820ecb63-f6d5-428d-a065-a5617489500e None None] [instance: 85b6aa5b-72c1-415f-8552-19d0cd3859d6] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:39:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:39:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:39:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:39:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:39:54 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:39:54 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=6741MB free_disk=25.620006561279297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 937978de-8e83-42e7-b906-ccc226924f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance fba812b3-7791-463f-9c86-a51ae7a7457d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 792b5efb-63fa-4e87-b114-61de6180b2c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 63ea93a3-9a33-42fd-af3a-686b848d0dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 23af7614-b27e-4e97-8180-5289cf8d9bcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ca81b728-2fd8-46d9-822d-2a468fd507e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a86048fe-ddbb-49b3-b2da-8efc895346ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2881e7a6-0099-4b87-819b-c36dd3db99c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:39:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.870s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:39:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:39:56 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693049981.1030924, 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:39:56 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] VM Stopped (Lifecycle Event)
Aug 26 11:39:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-77bfd44c-8f05-41ac-8f4d-afa5b2355240 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:39:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:40:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-e24db38a-c53a-47a6-a415-e358e8a9817c req-eebda5c8-7f77-4657-8e76-653a84edc03c service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event volume-reimaged-d6769dd3-49e3-48fc-8c4f-907a17b55517 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e24db38a-c53a-47a6-a415-e358e8a9817c req-eebda5c8-7f77-4657-8e76-653a84edc03c service nova] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e24db38a-c53a-47a6-a415-e358e8a9817c req-eebda5c8-7f77-4657-8e76-653a84edc03c service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e24db38a-c53a-47a6-a415-e358e8a9817c req-eebda5c8-7f77-4657-8e76-653a84edc03c service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-e24db38a-c53a-47a6-a415-e358e8a9817c req-eebda5c8-7f77-4657-8e76-653a84edc03c service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Processing event volume-reimaged-d6769dd3-49e3-48fc-8c4f-907a17b55517 {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 26 11:40:06 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:40:06 user nova-compute[73068]: INFO nova.virt.block_device [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Booting with volume d6769dd3-49e3-48fc-8c4f-907a17b55517 at /dev/vda
Aug 26 11:40:07 user nova-compute[73068]: DEBUG os_brick.utils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2094d4b-054c-41c2-819c-6595691e9c51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c55b8-8d48-4c11-acb4-40fa53a96206]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2c7840-98fe-4afd-a478-b480c27f022e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e44575-4f78-4274-b574-7d19bbe73b60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:40:07 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:40:07 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[270224ae-f04f-4411-99ee-80cb09ffb1bc]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG os_brick.utils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:40:07 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Updating existing volume attachment record: 9263276d-faf8-40ac-aab4-8a5bb6016540 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:40:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:40:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Creating image(s)
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Ensure instance console log exists: /opt/stack/data/nova/instances/8a96b57f-dd74-45b8-aa23-a6187dc4bb93/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Start _get_guest_xml network_info=[{"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '9263276d-faf8-40ac-aab4-8a5bb6016540', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFyOtqMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a96b57f-dd74-45b8-aa23-a6187dc4bb93', 'attached_at': '', 'detached_at': '', 'volume_id': 'd6769dd3-49e3-48fc-8c4f-907a17b55517', 'serial': 'd6769dd3-49e3-48fc-8c4f-907a17b55517'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:40:19 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 11:40:19 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFyOtqMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:40:19 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:40:19 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:40:19 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcfba1a-b384-48bb-b2f6-ee54a8104af9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:40:19 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3128e0-1565-422f-94ed-8895008d4ee2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517] added
Aug 26 11:40:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2b0307-c236-4ef5-b35a-717572167e44]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b889a3-0c2c-424a-b4ed-a60b53da65e2]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFyOtqMN {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JFyOtqMN" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2ac65b-b176-48dd-9803-3a92c6261458]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JFyOtqMN'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa244c1-97cf-4f79-a50e-bc84e5963ad0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fc0a9c-b6ab-450a-a793-4d50e3ddef03]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:40:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:40:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88709f1-feb6-452d-9d1d-308d64ffa2cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260]
Aug 26 11:40:19 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260] successful.
Aug 26 11:40:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[33753da7-8578-4bd4-b1fc-d78449d8d6de]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c8dcb9-40bd-4076-906f-4765caaf8396]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:40:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:40:19 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:40:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cca6426-a180-4a29-835d-f7651f4aac3a]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:40:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFyOtqMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26634613236373161', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634613236373161', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-772664691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-800782579',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/ZA4n0oqdwxudhPdUfBqQgXyjpwc/T+oPc5U+vqaCyvzEcT70JQD8EejyFZzqJOf+nGQXLZHuQHaE86x94DM7IeG2QP7b5azKYS86x18eGLwCVUieLMNu0xFns9T2eA==',key_name='tempest-keypair-1654929932',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:38:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6d54004525be4f06a7f9c1dc86ec3248',ramdisk_id='',reservation_id='r-5ar52vv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1026667147',owner_user_name='tempest-ServerActionsV293TestJSON-1026667147-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bd5b5460f15416c8b7851b85fe3da30',uuid=8a96b57f-dd74-45b8-aa23-a6187dc4bb93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converting VIF {"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:40:20 user nova-compute[73068]:   <uuid>8a96b57f-dd74-45b8-aa23-a6187dc4bb93</uuid>
Aug 26 11:40:20 user nova-compute[73068]:   <name>instance-00000009</name>
Aug 26 11:40:20 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:40:20 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:40:20 user nova-compute[73068]:   <metadata>
Aug 26 11:40:20 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:40:20 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:40:20 user nova-compute[73068]:       <nova:name>tempest-ServerActionsV293TestJSON-server-772664691</nova:name>
Aug 26 11:40:20 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:40:19</nova:creationTime>
Aug 26 11:40:20 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:40:20 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:40:20 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:40:20 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:40:20 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:40:20 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:40:20 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:40:20 user nova-compute[73068]:       <nova:owner>
Aug 26 11:40:20 user nova-compute[73068]:         <nova:user uuid="4bd5b5460f15416c8b7851b85fe3da30">tempest-ServerActionsV293TestJSON-1026667147-project-member</nova:user>
Aug 26 11:40:20 user nova-compute[73068]:         <nova:project uuid="6d54004525be4f06a7f9c1dc86ec3248">tempest-ServerActionsV293TestJSON-1026667147</nova:project>
Aug 26 11:40:20 user nova-compute[73068]:       </nova:owner>
Aug 26 11:40:20 user nova-compute[73068]:       <nova:ports>
Aug 26 11:40:20 user nova-compute[73068]:         <nova:port uuid="2000fb73-9c36-4d66-802c-4e5b0aa88226">
Aug 26 11:40:20 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 11:40:20 user nova-compute[73068]:         </nova:port>
Aug 26 11:40:20 user nova-compute[73068]:       </nova:ports>
Aug 26 11:40:20 user nova-compute[73068]:     </nova:instance>
Aug 26 11:40:20 user nova-compute[73068]:   </metadata>
Aug 26 11:40:20 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:40:20 user nova-compute[73068]:     <system>
Aug 26 11:40:20 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:40:20 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:40:20 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:40:20 user nova-compute[73068]:       <entry name="serial">8a96b57f-dd74-45b8-aa23-a6187dc4bb93</entry>
Aug 26 11:40:20 user nova-compute[73068]:       <entry name="uuid">8a96b57f-dd74-45b8-aa23-a6187dc4bb93</entry>
Aug 26 11:40:20 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:40:20 user nova-compute[73068]:     </system>
Aug 26 11:40:20 user nova-compute[73068]:   </sysinfo>
Aug 26 11:40:20 user nova-compute[73068]:   <os>
Aug 26 11:40:20 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:40:20 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:40:20 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:40:20 user nova-compute[73068]:   </os>
Aug 26 11:40:20 user nova-compute[73068]:   <features>
Aug 26 11:40:20 user nova-compute[73068]:     <acpi/>
Aug 26 11:40:20 user nova-compute[73068]:     <apic/>
Aug 26 11:40:20 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:40:20 user nova-compute[73068]:   </features>
Aug 26 11:40:20 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:40:20 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:40:20 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:40:20 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:40:20 user nova-compute[73068]:   </clock>
Aug 26 11:40:20 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:40:20 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:40:20 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:40:20 user nova-compute[73068]:   </cpu>
Aug 26 11:40:20 user nova-compute[73068]:   <devices>
Aug 26 11:40:20 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:40:20 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:40:20 user nova-compute[73068]:       <source dev="/dev/sdb"/>
Aug 26 11:40:20 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:40:20 user nova-compute[73068]:       <serial>d6769dd3-49e3-48fc-8c4f-907a17b55517</serial>
Aug 26 11:40:20 user nova-compute[73068]:     </disk>
Aug 26 11:40:20 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:40:20 user nova-compute[73068]:       <mac address="fa:16:3e:f6:aa:bd"/>
Aug 26 11:40:20 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:40:20 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:40:20 user nova-compute[73068]:       <target dev="tap2000fb73-9c"/>
Aug 26 11:40:20 user nova-compute[73068]:     </interface>
Aug 26 11:40:20 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:40:20 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/8a96b57f-dd74-45b8-aa23-a6187dc4bb93/console.log" append="off"/>
Aug 26 11:40:20 user nova-compute[73068]:     </serial>
Aug 26 11:40:20 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:40:20 user nova-compute[73068]:     <video>
Aug 26 11:40:20 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:40:20 user nova-compute[73068]:     </video>
Aug 26 11:40:20 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:40:20 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:40:20 user nova-compute[73068]:     </rng>
Aug 26 11:40:20 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:40:20 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:40:20 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:40:20 user nova-compute[73068]:     </memballoon>
Aug 26 11:40:20 user nova-compute[73068]:   </devices>
Aug 26 11:40:20 user nova-compute[73068]: </domain>
Aug 26 11:40:20 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-772664691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-800782579',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/ZA4n0oqdwxudhPdUfBqQgXyjpwc/T+oPc5U+vqaCyvzEcT70JQD8EejyFZzqJOf+nGQXLZHuQHaE86x94DM7IeG2QP7b5azKYS86x18eGLwCVUieLMNu0xFns9T2eA==',key_name='tempest-keypair-1654929932',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:38:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6d54004525be4f06a7f9c1dc86ec3248',ramdisk_id='',reservation_id='r-5ar52vv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1026667147',owner_user_name='tempest-ServerActionsV293TestJSON-1026667147-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:40:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bd5b5460f15416c8b7851b85fe3da30',uuid=8a96b57f-dd74-45b8-aa23-a6187dc4bb93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converting VIF {"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG os_vif [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2000fb73-9c, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2000fb73-9c, col_values=(('external_ids', {'iface-id': '2000fb73-9c36-4d66-802c-4e5b0aa88226', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:aa:bd', 'vm-uuid': '8a96b57f-dd74-45b8-aa23-a6187dc4bb93'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:20 user nova-compute[73068]: INFO os_vif [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c')
Aug 26 11:40:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:40:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] No VIF found with MAC fa:16:3e:f6:aa:bd, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:40:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-4d2a2736-1b9b-4e21-81a6-fe6bbb1d500f req-1db5f6a9-658d-4f50-be30-29966f604872 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4d2a2736-1b9b-4e21-81a6-fe6bbb1d500f req-1db5f6a9-658d-4f50-be30-29966f604872 service nova] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4d2a2736-1b9b-4e21-81a6-fe6bbb1d500f req-1db5f6a9-658d-4f50-be30-29966f604872 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4d2a2736-1b9b-4e21-81a6-fe6bbb1d500f req-1db5f6a9-658d-4f50-be30-29966f604872 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-4d2a2736-1b9b-4e21-81a6-fe6bbb1d500f req-1db5f6a9-658d-4f50-be30-29966f604872 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] No waiting events found dispatching network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:40:22 user nova-compute[73068]: WARNING nova.compute.manager [req-4d2a2736-1b9b-4e21-81a6-fe6bbb1d500f req-1db5f6a9-658d-4f50-be30-29966f604872 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received unexpected event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 11:40:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050024.316869, 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:40:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] VM Resumed (Lifecycle Event)
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:40:24 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Instance spawned successfully.
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050024.318006, 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:40:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] VM Started (Lifecycle Event)
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:40:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-bca9bbb2-e6bf-4cf4-8fef-c61563d25707 req-9b977f6e-4b86-41a4-b4a9-486118e7df28 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bca9bbb2-e6bf-4cf4-8fef-c61563d25707 req-9b977f6e-4b86-41a4-b4a9-486118e7df28 service nova] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bca9bbb2-e6bf-4cf4-8fef-c61563d25707 req-9b977f6e-4b86-41a4-b4a9-486118e7df28 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bca9bbb2-e6bf-4cf4-8fef-c61563d25707 req-9b977f6e-4b86-41a4-b4a9-486118e7df28 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-bca9bbb2-e6bf-4cf4-8fef-c61563d25707 req-9b977f6e-4b86-41a4-b4a9-486118e7df28 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] No waiting events found dispatching network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:40:24 user nova-compute[73068]: WARNING nova.compute.manager [req-bca9bbb2-e6bf-4cf4-8fef-c61563d25707 req-9b977f6e-4b86-41a4-b4a9-486118e7df28 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received unexpected event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 11:40:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73068) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 11:40:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e24db38a-c53a-47a6-a415-e358e8a9817c tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.081s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "deb7b9f5-d717-4d73-997a-0914c56f546c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:40:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:27 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:40:27 user nova-compute[73068]: INFO nova.compute.claims [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Claim successful on node user
Aug 26 11:40:28 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:40:28 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:40:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:40:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:40:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:40:28 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:40:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:40:28 user nova-compute[73068]: DEBUG nova.policy [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed086ebc2de14a0f9b55c87a40f5f621', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1112219a9fc34797b1d9f5e872bea350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:40:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:40:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:40:28 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Creating image(s)
Aug 26 11:40:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "/opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "/opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "/opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.207s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk 1073741824" returned: 0 in 0.060s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Successfully created port: 08d83cbe-2f4d-434d-bddf-877e284a6ae1 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.296s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Checking if we can resize image /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Cannot resize image /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Ensure instance console log exists: /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Successfully updated port: 08d83cbe-2f4d-434d-bddf-877e284a6ae1 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "refresh_cache-deb7b9f5-d717-4d73-997a-0914c56f546c" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquired lock "refresh_cache-deb7b9f5-d717-4d73-997a-0914c56f546c" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-bb9ea36e-504b-4aa6-8107-4ef5a5fdfc74 req-e9360e77-f7fa-4663-bf1e-4f71b10d84ac service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Received event network-changed-08d83cbe-2f4d-434d-bddf-877e284a6ae1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-bb9ea36e-504b-4aa6-8107-4ef5a5fdfc74 req-e9360e77-f7fa-4663-bf1e-4f71b10d84ac service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Refreshing instance network info cache due to event network-changed-08d83cbe-2f4d-434d-bddf-877e284a6ae1. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bb9ea36e-504b-4aa6-8107-4ef5a5fdfc74 req-e9360e77-f7fa-4663-bf1e-4f71b10d84ac service nova] Acquiring lock "refresh_cache-deb7b9f5-d717-4d73-997a-0914c56f546c" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Updating instance_info_cache with network_info: [{"id": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "address": "fa:16:3e:56:fb:f9", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d83cbe-2f", "ovs_interfaceid": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Releasing lock "refresh_cache-deb7b9f5-d717-4d73-997a-0914c56f546c" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Instance network_info: |[{"id": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "address": "fa:16:3e:56:fb:f9", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d83cbe-2f", "ovs_interfaceid": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bb9ea36e-504b-4aa6-8107-4ef5a5fdfc74 req-e9360e77-f7fa-4663-bf1e-4f71b10d84ac service nova] Acquired lock "refresh_cache-deb7b9f5-d717-4d73-997a-0914c56f546c" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.network.neutron [req-bb9ea36e-504b-4aa6-8107-4ef5a5fdfc74 req-e9360e77-f7fa-4663-bf1e-4f71b10d84ac service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Refreshing network info cache for port 08d83cbe-2f4d-434d-bddf-877e284a6ae1 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Start _get_guest_xml network_info=[{"id": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "address": "fa:16:3e:56:fb:f9", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d83cbe-2f", "ovs_interfaceid": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:40:30 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:40:30 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-155143880',display_name='tempest-VolumesAdminNegativeTest-server-155143880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-155143880',id=15,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1112219a9fc34797b1d9f5e872bea350',ramdisk_id='',reservation_id='r-k3uw5yw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-175851604',owner_user_name='tempest-VolumesAdminNegativeTest-175851604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:40:29Z,user_data=None,user_id='ed086ebc2de14a0f9b55c87a40f5f621',uuid=deb7b9f5-d717-4d73-997a-0914c56f546c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "address": "fa:16:3e:56:fb:f9", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d83cbe-2f", "ovs_interfaceid": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converting VIF {"id": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "address": "fa:16:3e:56:fb:f9", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d83cbe-2f", "ovs_interfaceid": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:f9,bridge_name='br-int',has_traffic_filtering=True,id=08d83cbe-2f4d-434d-bddf-877e284a6ae1,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d83cbe-2f') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lazy-loading 'pci_devices' on Instance uuid deb7b9f5-d717-4d73-997a-0914c56f546c {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:40:30 user nova-compute[73068]:   <uuid>deb7b9f5-d717-4d73-997a-0914c56f546c</uuid>
Aug 26 11:40:30 user nova-compute[73068]:   <name>instance-0000000f</name>
Aug 26 11:40:30 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:40:30 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:40:30 user nova-compute[73068]:   <metadata>
Aug 26 11:40:30 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:40:30 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:40:30 user nova-compute[73068]:       <nova:name>tempest-VolumesAdminNegativeTest-server-155143880</nova:name>
Aug 26 11:40:30 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:40:30</nova:creationTime>
Aug 26 11:40:30 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:40:30 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:40:30 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:40:30 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:40:30 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:40:30 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:40:30 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:40:30 user nova-compute[73068]:       <nova:owner>
Aug 26 11:40:30 user nova-compute[73068]:         <nova:user uuid="ed086ebc2de14a0f9b55c87a40f5f621">tempest-VolumesAdminNegativeTest-175851604-project-member</nova:user>
Aug 26 11:40:30 user nova-compute[73068]:         <nova:project uuid="1112219a9fc34797b1d9f5e872bea350">tempest-VolumesAdminNegativeTest-175851604</nova:project>
Aug 26 11:40:30 user nova-compute[73068]:       </nova:owner>
Aug 26 11:40:30 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:40:30 user nova-compute[73068]:       <nova:ports>
Aug 26 11:40:30 user nova-compute[73068]:         <nova:port uuid="08d83cbe-2f4d-434d-bddf-877e284a6ae1">
Aug 26 11:40:30 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 11:40:30 user nova-compute[73068]:         </nova:port>
Aug 26 11:40:30 user nova-compute[73068]:       </nova:ports>
Aug 26 11:40:30 user nova-compute[73068]:     </nova:instance>
Aug 26 11:40:30 user nova-compute[73068]:   </metadata>
Aug 26 11:40:30 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:40:30 user nova-compute[73068]:     <system>
Aug 26 11:40:30 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:40:30 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:40:30 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:40:30 user nova-compute[73068]:       <entry name="serial">deb7b9f5-d717-4d73-997a-0914c56f546c</entry>
Aug 26 11:40:30 user nova-compute[73068]:       <entry name="uuid">deb7b9f5-d717-4d73-997a-0914c56f546c</entry>
Aug 26 11:40:30 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:40:30 user nova-compute[73068]:     </system>
Aug 26 11:40:30 user nova-compute[73068]:   </sysinfo>
Aug 26 11:40:30 user nova-compute[73068]:   <os>
Aug 26 11:40:30 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:40:30 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:40:30 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:40:30 user nova-compute[73068]:   </os>
Aug 26 11:40:30 user nova-compute[73068]:   <features>
Aug 26 11:40:30 user nova-compute[73068]:     <acpi/>
Aug 26 11:40:30 user nova-compute[73068]:     <apic/>
Aug 26 11:40:30 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:40:30 user nova-compute[73068]:   </features>
Aug 26 11:40:30 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:40:30 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:40:30 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:40:30 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:40:30 user nova-compute[73068]:   </clock>
Aug 26 11:40:30 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:40:30 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:40:30 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:40:30 user nova-compute[73068]:   </cpu>
Aug 26 11:40:30 user nova-compute[73068]:   <devices>
Aug 26 11:40:30 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:40:30 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:40:30 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk"/>
Aug 26 11:40:30 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:40:30 user nova-compute[73068]:     </disk>
Aug 26 11:40:30 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:40:30 user nova-compute[73068]:       <mac address="fa:16:3e:56:fb:f9"/>
Aug 26 11:40:30 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:40:30 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:40:30 user nova-compute[73068]:       <target dev="tap08d83cbe-2f"/>
Aug 26 11:40:30 user nova-compute[73068]:     </interface>
Aug 26 11:40:30 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:40:30 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/console.log" append="off"/>
Aug 26 11:40:30 user nova-compute[73068]:     </serial>
Aug 26 11:40:30 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:40:30 user nova-compute[73068]:     <video>
Aug 26 11:40:30 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:40:30 user nova-compute[73068]:     </video>
Aug 26 11:40:30 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:40:30 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:40:30 user nova-compute[73068]:     </rng>
Aug 26 11:40:30 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:40:30 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:40:30 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:40:30 user nova-compute[73068]:     </memballoon>
Aug 26 11:40:30 user nova-compute[73068]:   </devices>
Aug 26 11:40:30 user nova-compute[73068]: </domain>
Aug 26 11:40:30 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-155143880',display_name='tempest-VolumesAdminNegativeTest-server-155143880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-155143880',id=15,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1112219a9fc34797b1d9f5e872bea350',ramdisk_id='',reservation_id='r-k3uw5yw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-175851604',owner_user_name='tempest-VolumesAdminNegativeTest-175851604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:40:29Z,user_data=None,user_id='ed086ebc2de14a0f9b55c87a40f5f621',uuid=deb7b9f5-d717-4d73-997a-0914c56f546c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "address": "fa:16:3e:56:fb:f9", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d83cbe-2f", "ovs_interfaceid": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converting VIF {"id": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "address": "fa:16:3e:56:fb:f9", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d83cbe-2f", "ovs_interfaceid": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:f9,bridge_name='br-int',has_traffic_filtering=True,id=08d83cbe-2f4d-434d-bddf-877e284a6ae1,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d83cbe-2f') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG os_vif [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:f9,bridge_name='br-int',has_traffic_filtering=True,id=08d83cbe-2f4d-434d-bddf-877e284a6ae1,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d83cbe-2f') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08d83cbe-2f, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08d83cbe-2f, col_values=(('external_ids', {'iface-id': '08d83cbe-2f4d-434d-bddf-877e284a6ae1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:fb:f9', 'vm-uuid': 'deb7b9f5-d717-4d73-997a-0914c56f546c'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:40:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:30 user nova-compute[73068]: INFO os_vif [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:f9,bridge_name='br-int',has_traffic_filtering=True,id=08d83cbe-2f4d-434d-bddf-877e284a6ae1,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d83cbe-2f')
Aug 26 11:40:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:40:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] No VIF found with MAC fa:16:3e:56:fb:f9, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:40:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-bb9ea36e-504b-4aa6-8107-4ef5a5fdfc74 req-e9360e77-f7fa-4663-bf1e-4f71b10d84ac service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Updated VIF entry in instance network info cache for port 08d83cbe-2f4d-434d-bddf-877e284a6ae1. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:40:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-bb9ea36e-504b-4aa6-8107-4ef5a5fdfc74 req-e9360e77-f7fa-4663-bf1e-4f71b10d84ac service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Updating instance_info_cache with network_info: [{"id": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "address": "fa:16:3e:56:fb:f9", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d83cbe-2f", "ovs_interfaceid": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:40:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bb9ea36e-504b-4aa6-8107-4ef5a5fdfc74 req-e9360e77-f7fa-4663-bf1e-4f71b10d84ac service nova] Releasing lock "refresh_cache-deb7b9f5-d717-4d73-997a-0914c56f546c" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:40:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-a4808023-5a39-42d3-819e-8ea8eb0708bc req-ddb72e9c-1c33-41f7-8e07-6cc65a7cdd52 service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Received event network-vif-plugged-08d83cbe-2f4d-434d-bddf-877e284a6ae1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a4808023-5a39-42d3-819e-8ea8eb0708bc req-ddb72e9c-1c33-41f7-8e07-6cc65a7cdd52 service nova] Acquiring lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a4808023-5a39-42d3-819e-8ea8eb0708bc req-ddb72e9c-1c33-41f7-8e07-6cc65a7cdd52 service nova] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a4808023-5a39-42d3-819e-8ea8eb0708bc req-ddb72e9c-1c33-41f7-8e07-6cc65a7cdd52 service nova] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-a4808023-5a39-42d3-819e-8ea8eb0708bc req-ddb72e9c-1c33-41f7-8e07-6cc65a7cdd52 service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] No waiting events found dispatching network-vif-plugged-08d83cbe-2f4d-434d-bddf-877e284a6ae1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:40:32 user nova-compute[73068]: WARNING nova.compute.manager [req-a4808023-5a39-42d3-819e-8ea8eb0708bc req-ddb72e9c-1c33-41f7-8e07-6cc65a7cdd52 service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Received unexpected event network-vif-plugged-08d83cbe-2f4d-434d-bddf-877e284a6ae1 for instance with vm_state building and task_state spawning.
Aug 26 11:40:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "ca81b728-2fd8-46d9-822d-2a468fd507e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:33 user nova-compute[73068]: INFO nova.compute.manager [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Terminating instance
Aug 26 11:40:33 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:40:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Instance destroyed successfully.
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.objects.instance [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lazy-loading 'resources' on Instance uuid ca81b728-2fd8-46d9-822d-2a468fd507e3 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:38:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1025715738',display_name='tempest-ServersNegativeTestJSON-server-1025715738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1025715738',id=12,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:38:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17bdd7cec1d84290be2b2a22a7834b40',ramdisk_id='',reservation_id='r-a4uq102u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-41614951',owner_user_name='tempest-ServersNegativeTestJSON-41614951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:38:50Z,user_data=None,user_id='442fddac9e534bbc9d8a5966e6bc3c26',uuid=ca81b728-2fd8-46d9-822d-2a468fd507e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "address": "fa:16:3e:8d:1a:71", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843afae1-34", "ovs_interfaceid": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converting VIF {"id": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "address": "fa:16:3e:8d:1a:71", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap843afae1-34", "ovs_interfaceid": "843afae1-3465-4a0e-8b55-5a05b1b8fdf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:71,bridge_name='br-int',has_traffic_filtering=True,id=843afae1-3465-4a0e-8b55-5a05b1b8fdf1,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843afae1-34') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG os_vif [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:71,bridge_name='br-int',has_traffic_filtering=True,id=843afae1-3465-4a0e-8b55-5a05b1b8fdf1,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843afae1-34') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap843afae1-34, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:34 user nova-compute[73068]: INFO os_vif [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:1a:71,bridge_name='br-int',has_traffic_filtering=True,id=843afae1-3465-4a0e-8b55-5a05b1b8fdf1,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap843afae1-34')
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Deleting instance files /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3_del
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Deletion of /opt/stack/data/nova/instances/ca81b728-2fd8-46d9-822d-2a468fd507e3_del complete
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.compute.manager [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050034.7871413, deb7b9f5-d717-4d73-997a-0914c56f546c => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] VM Resumed (Lifecycle Event)
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Instance spawned successfully.
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Received event network-vif-plugged-08d83cbe-2f4d-434d-bddf-877e284a6ae1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] Acquiring lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] No waiting events found dispatching network-vif-plugged-08d83cbe-2f4d-434d-bddf-877e284a6ae1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:40:34 user nova-compute[73068]: WARNING nova.compute.manager [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Received unexpected event network-vif-plugged-08d83cbe-2f4d-434d-bddf-877e284a6ae1 for instance with vm_state building and task_state spawning.
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Received event network-vif-unplugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] Acquiring lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] No waiting events found dispatching network-vif-unplugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Received event network-vif-unplugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Received event network-vif-plugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] Acquiring lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] No waiting events found dispatching network-vif-plugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:40:34 user nova-compute[73068]: WARNING nova.compute.manager [req-7b99feec-37a8-4792-af99-47e8ad60da0d req-6b9e3180-2b09-4930-bcb8-8912609122da service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Received unexpected event network-vif-plugged-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 for instance with vm_state active and task_state deleting.
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050034.7907376, deb7b9f5-d717-4d73-997a-0914c56f546c => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] VM Started (Lifecycle Event)
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-1e4775d7-ce19-46e5-a799-682b398a48d4 req-fcaed4fe-568d-4d77-a92b-74f8848bdfa8 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Received event network-vif-deleted-843afae1-3465-4a0e-8b55-5a05b1b8fdf1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.compute.manager [req-1e4775d7-ce19-46e5-a799-682b398a48d4 req-fcaed4fe-568d-4d77-a92b-74f8848bdfa8 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Neutron deleted interface 843afae1-3465-4a0e-8b55-5a05b1b8fdf1; detaching it from the instance and deleting it from the info cache
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-1e4775d7-ce19-46e5-a799-682b398a48d4 req-fcaed4fe-568d-4d77-a92b-74f8848bdfa8 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Took 0.56 seconds to deallocate network for instance.
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-1e4775d7-ce19-46e5-a799-682b398a48d4 req-fcaed4fe-568d-4d77-a92b-74f8848bdfa8 service nova] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Detach interface failed, port_id=843afae1-3465-4a0e-8b55-5a05b1b8fdf1, reason: Instance ca81b728-2fd8-46d9-822d-2a468fd507e3 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.compute.manager [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 26 11:40:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:40:34 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:35 user nova-compute[73068]: INFO nova.compute.manager [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Took 7.14 seconds to build instance.
Aug 26 11:40:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b86ff93e-0277-4f82-8fef-a05b9f049743 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.273s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:35 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:40:35 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:40:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:35 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Deleted allocations for instance ca81b728-2fd8-46d9-822d-2a468fd507e3
Aug 26 11:40:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6584ef11-491a-4541-98cd-26eb6dc72a86 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "ca81b728-2fd8-46d9-822d-2a468fd507e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.121s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG nova.objects.instance [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'flavor' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:41 user nova-compute[73068]: INFO nova.compute.manager [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Attaching volume 9e986a9e-fe7b-40a5-9e70-d65765ceef6c to /dev/vdb
Aug 26 11:40:41 user nova-compute[73068]: DEBUG os_brick.utils [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b8e5b7-425b-4f12-b116-f0487354c8f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[451a5164-3073-4ad0-a1d6-415c82bea8a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f8ab53-6950-4021-9af4-109290345261]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e63aa3-2a0d-430c-809a-96a310a792cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:40:41 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:40:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35f4a59-619b-4cc5-995d-47d3d061eb1a]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG os_brick.utils [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:40:41 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating existing volume attachment record: 3efda72c-27b4-43e6-92e2-5aece1ca206d {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:40:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Acquiring lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Acquiring lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:46 user nova-compute[73068]: INFO nova.compute.manager [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Terminating instance
Aug 26 11:40:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:40:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-3d3bcb5d-3017-4a67-9470-766061684454 req-9fe5ba4c-2732-439b-85cd-7faf90adeca1 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Received event network-vif-unplugged-ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d3bcb5d-3017-4a67-9470-766061684454 req-9fe5ba4c-2732-439b-85cd-7faf90adeca1 service nova] Acquiring lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d3bcb5d-3017-4a67-9470-766061684454 req-9fe5ba4c-2732-439b-85cd-7faf90adeca1 service nova] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d3bcb5d-3017-4a67-9470-766061684454 req-9fe5ba4c-2732-439b-85cd-7faf90adeca1 service nova] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-3d3bcb5d-3017-4a67-9470-766061684454 req-9fe5ba4c-2732-439b-85cd-7faf90adeca1 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] No waiting events found dispatching network-vif-unplugged-ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-3d3bcb5d-3017-4a67-9470-766061684454 req-9fe5ba4c-2732-439b-85cd-7faf90adeca1 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Received event network-vif-unplugged-ddc74644-b198-466a-8a7a-d9176c59f737 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:40:47 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Instance destroyed successfully.
Aug 26 11:40:47 user nova-compute[73068]: DEBUG nova.objects.instance [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lazy-loading 'resources' on Instance uuid 63ea93a3-9a33-42fd-af3a-686b848d0dc1 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1375461997',display_name='tempest-VolumesAssistedSnapshotsTest-server-1375461997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1375461997',id=8,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3C4ZSUOTUPttg2eHd4sb+ubVZpyRDd6BfxyGews9kBA9iYguIj1xQfr9TGWA6xvebsDAX53tBKcYGfb/YA7bjxXIAixAkzT6MLAyFgz/WD+d1UZzFeZEVDxwRAuiNJCA==',key_name='tempest-keypair-1822653618',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:37:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2a44dcfea3443b3b08867640a2de1e9',ramdisk_id='',reservation_id='r-1vhozwqv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-43714610',owner_user_name='tempest-VolumesAssistedSnapshotsTest-43714610-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef8797cad2dd46a4b63997c05db49299',uuid=63ea93a3-9a33-42fd-af3a-686b848d0dc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddc74644-b198-466a-8a7a-d9176c59f737", "address": "fa:16:3e:04:90:d1", "network": {"id": "a1c559c7-3c86-48bb-b5ad-fe7637d00998", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2071799706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a44dcfea3443b3b08867640a2de1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc74644-b1", "ovs_interfaceid": "ddc74644-b198-466a-8a7a-d9176c59f737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Converting VIF {"id": "ddc74644-b198-466a-8a7a-d9176c59f737", "address": "fa:16:3e:04:90:d1", "network": {"id": "a1c559c7-3c86-48bb-b5ad-fe7637d00998", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2071799706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a44dcfea3443b3b08867640a2de1e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc74644-b1", "ovs_interfaceid": "ddc74644-b198-466a-8a7a-d9176c59f737", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:90:d1,bridge_name='br-int',has_traffic_filtering=True,id=ddc74644-b198-466a-8a7a-d9176c59f737,network=Network(a1c559c7-3c86-48bb-b5ad-fe7637d00998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc74644-b1') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG os_vif [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:90:d1,bridge_name='br-int',has_traffic_filtering=True,id=ddc74644-b198-466a-8a7a-d9176c59f737,network=Network(a1c559c7-3c86-48bb-b5ad-fe7637d00998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc74644-b1') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddc74644-b1, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:47 user nova-compute[73068]: INFO os_vif [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:90:d1,bridge_name='br-int',has_traffic_filtering=True,id=ddc74644-b198-466a-8a7a-d9176c59f737,network=Network(a1c559c7-3c86-48bb-b5ad-fe7637d00998),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc74644-b1')
Aug 26 11:40:47 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Deleting instance files /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1_del
Aug 26 11:40:47 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Deletion of /opt/stack/data/nova/instances/63ea93a3-9a33-42fd-af3a-686b848d0dc1_del complete
Aug 26 11:40:47 user nova-compute[73068]: INFO nova.compute.manager [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 26 11:40:47 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:40:47 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:40:48 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:40:48 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Took 1.01 seconds to deallocate network for instance.
Aug 26 11:40:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-5c8e869c-fed4-48d5-ae1c-3764afc42c49 req-97a5753a-79be-4a77-a9aa-3e552f8d5c41 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Received event network-vif-deleted-ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:49 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050034.196015, ca81b728-2fd8-46d9-822d-2a468fd507e3 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:40:49 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] VM Stopped (Lifecycle Event)
Aug 26 11:40:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-51c1be0f-8fd3-4552-a564-2b0050dc7a22 None None] [instance: ca81b728-2fd8-46d9-822d-2a468fd507e3] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:40:49 user nova-compute[73068]: DEBUG nova.compute.manager [req-2b1afc46-b1e0-462d-9424-0423e746fa6b req-8e1f9a49-bf5e-4d0a-87b5-5672def5ca02 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Received event network-vif-plugged-ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:40:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2b1afc46-b1e0-462d-9424-0423e746fa6b req-8e1f9a49-bf5e-4d0a-87b5-5672def5ca02 service nova] Acquiring lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2b1afc46-b1e0-462d-9424-0423e746fa6b req-8e1f9a49-bf5e-4d0a-87b5-5672def5ca02 service nova] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2b1afc46-b1e0-462d-9424-0423e746fa6b req-8e1f9a49-bf5e-4d0a-87b5-5672def5ca02 service nova] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:49 user nova-compute[73068]: DEBUG nova.compute.manager [req-2b1afc46-b1e0-462d-9424-0423e746fa6b req-8e1f9a49-bf5e-4d0a-87b5-5672def5ca02 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] No waiting events found dispatching network-vif-plugged-ddc74644-b198-466a-8a7a-d9176c59f737 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:40:49 user nova-compute[73068]: WARNING nova.compute.manager [req-2b1afc46-b1e0-462d-9424-0423e746fa6b req-8e1f9a49-bf5e-4d0a-87b5-5672def5ca02 service nova] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Received unexpected event network-vif-plugged-ddc74644-b198-466a-8a7a-d9176c59f737 for instance with vm_state deleted and task_state None.
Aug 26 11:40:49 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:40:49 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:40:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:49 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Deleted allocations for instance 63ea93a3-9a33-42fd-af3a-686b848d0dc1
Aug 26 11:40:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0b643dc0-a80e-40db-8602-9468d67ff89c tempest-VolumesAssistedSnapshotsTest-43714610 tempest-VolumesAssistedSnapshotsTest-43714610-project-member] Lock "63ea93a3-9a33-42fd-af3a-686b848d0dc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.826s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:54 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:40:54 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:40:54 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:40:54 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEOmwvYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:40:55 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:40:55 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:40:55 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[da18319b-35f2-4045-91ca-37b491c9351f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:40:55 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[75154474-2c15-4bc0-b4e3-5a121428c333]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c] added
Aug 26 11:40:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[59716e3d-329e-460b-ad4b-238aa5b19193]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60ec8e8-f003-47a6-84ef-dcc07ef7201e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEOmwvYr {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEOmwvYr" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[44afcd44-c2ea-49f4-999a-68a5db5cf872]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fEOmwvYr'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0750db31-4159-4b40-bb6b-466ee1ae9ba3]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea70fdb8-5451-4a21-9d6b-ee5ae06eb045]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:40:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:40:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bd299a-4467-44c1-b3ee-f41160d03ebe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c, portal: 172.16.0.220,3260]
Aug 26 11:40:55 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c, portal: 172.16.0.220,3260] successful.
Aug 26 11:40:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69d3ccd-09a0-4587-97a2-e9dd8574e98f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee63431-d1df-4d11-84d2-884caef595ff]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:40:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:40:55 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:40:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] HCTL ('42', '-', '-', 0) found on session 16 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[761f67a9-d0ac-4c0f-bf62-2fcc0811685d]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Searching for a device in session 16 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:40:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEOmwvYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Updating instance_info_cache with network_info: [{"id": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "address": "fa:16:3e:7f:de:1f", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01dafe-b0", "ovs_interfaceid": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '23965383335313438', 'path': '/dev/sdk'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965383335313438', 'path': '/dev/sdk'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG nova.objects.instance [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'flavor' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:40:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:40:56 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:40:56 user nova-compute[73068]:   <source dev="/dev/sdk"/>
Aug 26 11:40:56 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:40:56 user nova-compute[73068]:   <serial>9e986a9e-fe7b-40a5-9e70-d65765ceef6c</serial>
Aug 26 11:40:56 user nova-compute[73068]: </disk>
Aug 26 11:40:56 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] No VIF found with MAC fa:16:3e:f6:f1:f0, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ccfc9161-842b-4917-8c4b-853b09962994 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.279s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:59 user nova-compute[73068]: INFO nova.compute.manager [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Rescuing
Aug 26 11:40:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquired lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating instance_info_cache with network_info: [{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Releasing lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:40:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.manager [req-bcaa6320-9ca9-43f2-88dd-42c249265e5d req-7c952852-4201-4814-84b6-a51f354e0bb9 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-unplugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bcaa6320-9ca9-43f2-88dd-42c249265e5d req-7c952852-4201-4814-84b6-a51f354e0bb9 service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bcaa6320-9ca9-43f2-88dd-42c249265e5d req-7c952852-4201-4814-84b6-a51f354e0bb9 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bcaa6320-9ca9-43f2-88dd-42c249265e5d req-7c952852-4201-4814-84b6-a51f354e0bb9 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.manager [req-bcaa6320-9ca9-43f2-88dd-42c249265e5d req-7c952852-4201-4814-84b6-a51f354e0bb9 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-unplugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:01 user nova-compute[73068]: WARNING nova.compute.manager [req-bcaa6320-9ca9-43f2-88dd-42c249265e5d req-7c952852-4201-4814-84b6-a51f354e0bb9 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received unexpected event network-vif-unplugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with vm_state active and task_state rescuing.
Aug 26 11:41:01 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Instance destroyed successfully.
Aug 26 11:41:01 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:41:01 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=6917MB free_disk=25.682292938232422GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:01 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Attempting a stable device rescue
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73068) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Instance directory exists: not creating {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 11:41:01 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Creating image(s)
Aug 26 11:41:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "/opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "/opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.objects.instance [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "e4f95f6c0116a9577f0f542a448492c586ac1d50" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "e4f95f6c0116a9577f0f542a448492c586ac1d50" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 937978de-8e83-42e7-b906-ccc226924f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance fba812b3-7791-463f-9c86-a51ae7a7457d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 792b5efb-63fa-4e87-b114-61de6180b2c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 23af7614-b27e-4e97-8180-5289cf8d9bcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a86048fe-ddbb-49b3-b2da-8efc895346ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2881e7a6-0099-4b87-819b-c36dd3db99c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance deb7b9f5-d717-4d73-997a-0914c56f546c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:41:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50.part --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-20af3044-1e70-45b5-ade2-0ba9dc150ed1 req-1d98502d-f3db-412d-9e7c-fb4ab13c0b21 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-changed-0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-20af3044-1e70-45b5-ade2-0ba9dc150ed1 req-1d98502d-f3db-412d-9e7c-fb4ab13c0b21 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing instance network info cache due to event network-changed-0627ade3-5789-4bab-8e59-684ca2e6b871. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-20af3044-1e70-45b5-ade2-0ba9dc150ed1 req-1d98502d-f3db-412d-9e7c-fb4ab13c0b21 service nova] Acquiring lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-20af3044-1e70-45b5-ade2-0ba9dc150ed1 req-1d98502d-f3db-412d-9e7c-fb4ab13c0b21 service nova] Acquired lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG nova.network.neutron [req-20af3044-1e70-45b5-ade2-0ba9dc150ed1 req-1d98502d-f3db-412d-9e7c-fb4ab13c0b21 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Refreshing network info cache for port 0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-c9d18712-ae08-4965-b1b5-130add4685d1 req-a82b3fb6-2502-4abb-af1c-38919867da98 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c9d18712-ae08-4965-b1b5-130add4685d1 req-a82b3fb6-2502-4abb-af1c-38919867da98 service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c9d18712-ae08-4965-b1b5-130add4685d1 req-a82b3fb6-2502-4abb-af1c-38919867da98 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c9d18712-ae08-4965-b1b5-130add4685d1 req-a82b3fb6-2502-4abb-af1c-38919867da98 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-c9d18712-ae08-4965-b1b5-130add4685d1 req-a82b3fb6-2502-4abb-af1c-38919867da98 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:02 user nova-compute[73068]: WARNING nova.compute.manager [req-c9d18712-ae08-4965-b1b5-130add4685d1 req-a82b3fb6-2502-4abb-af1c-38919867da98 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received unexpected event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with vm_state active and task_state rescuing.
Aug 26 11:41:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50.part --force-share --output=json" returned: 0 in 0.234s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG nova.virt.images [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] 75dc8077-f28c-470b-9c09-e5a503ffd0fa was qcow2, converting to raw {{(pid=73068) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50.part /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50.converted {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050047.7572207, 63ea93a3-9a33-42fd-af3a-686b848d0dc1 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:41:02 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] VM Stopped (Lifecycle Event)
Aug 26 11:41:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bfad219a-26f1-4e16-b200-c0776388832c None None] [instance: 63ea93a3-9a33-42fd-af3a-686b848d0dc1] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50.part /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50.converted" returned: 0 in 0.353s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50.converted --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:41:02 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.961s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "e4f95f6c0116a9577f0f542a448492c586ac1d50" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.913s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "e4f95f6c0116a9577f0f542a448492c586ac1d50" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "e4f95f6c0116a9577f0f542a448492c586ac1d50" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.compute.manager [req-09d44ccc-7911-481d-8758-46b279dc30ca req-b8df17ba-46e2-4c11-9850-632c16ba4456 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Received event network-changed-47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.compute.manager [req-09d44ccc-7911-481d-8758-46b279dc30ca req-b8df17ba-46e2-4c11-9850-632c16ba4456 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Refreshing instance network info cache due to event network-changed-47d313d2-edb6-4cb5-8739-505b93a3c024. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-09d44ccc-7911-481d-8758-46b279dc30ca req-b8df17ba-46e2-4c11-9850-632c16ba4456 service nova] Acquiring lock "refresh_cache-a86048fe-ddbb-49b3-b2da-8efc895346ba" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-09d44ccc-7911-481d-8758-46b279dc30ca req-b8df17ba-46e2-4c11-9850-632c16ba4456 service nova] Acquired lock "refresh_cache-a86048fe-ddbb-49b3-b2da-8efc895346ba" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.network.neutron [req-09d44ccc-7911-481d-8758-46b279dc30ca req-b8df17ba-46e2-4c11-9850-632c16ba4456 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Refreshing network info cache for port 47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.network.neutron [req-20af3044-1e70-45b5-ade2-0ba9dc150ed1 req-1d98502d-f3db-412d-9e7c-fb4ab13c0b21 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updated VIF entry in instance network info cache for port 0627ade3-5789-4bab-8e59-684ca2e6b871. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.network.neutron [req-20af3044-1e70-45b5-ade2-0ba9dc150ed1 req-1d98502d-f3db-412d-9e7c-fb4ab13c0b21 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [{"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50 --force-share --output=json" returned: 0 in 0.239s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50,backing_fmt=raw /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.rescue {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50,backing_fmt=raw /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.rescue" returned: 0 in 0.132s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "e4f95f6c0116a9577f0f542a448492c586ac1d50" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.objects.instance [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'migration_context' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-20af3044-1e70-45b5-ade2-0ba9dc150ed1 req-1d98502d-f3db-412d-9e7c-fb4ab13c0b21 service nova] Releasing lock "refresh_cache-8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.objects.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Object Instance<2e64329a-4cf4-4f10-bbb9-4bb50754841a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Start _get_guest_xml network_info=[{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "vif_mac": "fa:16:3e:f6:f1:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '75dc8077-f28c-470b-9c09-e5a503ffd0fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '3efda72c-27b4-43e6-92e2-5aece1ca206d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEOmwvYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '2e64329a-4cf4-4f10-bbb9-4bb50754841a', 'attached_at': '', 'detached_at': '', 'volume_id': '9e986a9e-fe7b-40a5-9e70-d65765ceef6c', 'serial': '9e986a9e-fe7b-40a5-9e70-d65765ceef6c'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.objects.instance [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'resources' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.objects.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Object Instance<2e64329a-4cf4-4f10-bbb9-4bb50754841a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.objects.instance [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.objects.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Object Instance<2e64329a-4cf4-4f10-bbb9-4bb50754841a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:41:03 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:41:03 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.objects.instance [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.objects.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Object Instance<2e64329a-4cf4-4f10-bbb9-4bb50754841a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEOmwvYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:41:03 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:03 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:03 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72c72fe-e30d-459d-9d0f-da26a57cec7e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fEOmwvYr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 11:41:03 user nova-compute[73068]: node.name = iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c
Aug 26 11:41:03 user nova-compute[73068]: node.tpgt = -1
Aug 26 11:41:03 user nova-compute[73068]: node.startup = automatic
Aug 26 11:41:03 user nova-compute[73068]: node.leading_login = No
Aug 26 11:41:03 user nova-compute[73068]: iface.iscsi_ifacename = default
Aug 26 11:41:03 user nova-compute[73068]: iface.net_ifacename = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.ipaddress = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.prefix_len = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.hwaddress = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.transport_name = tcp
Aug 26 11:41:03 user nova-compute[73068]: iface.initiatorname = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.state = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.vlan_id = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.vlan_priority = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.vlan_state = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.iface_num = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.mtu = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.port = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.bootproto = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.subnet_mask = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.gateway = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.dhcp_alt_client_id = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.dhcp_dns = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.dhcp_learn_iqn = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.dhcp_vendor_id_state = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.dhcp_vendor_id = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.dhcp_slp_da = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.fragmentation = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.gratuitous_arp = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.incoming_forwarding = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.tos_state = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.tos = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.ttl = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.delayed_ack = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.tcp_nagle = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.tcp_wsf_state = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.tcp_wsf = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.tcp_timer_scale = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.tcp_timestamp = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.redirect = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.def_task_mgmt_timeout = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.header_digest = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.data_digest = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.immediate_data = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.initial_r2t = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.data_seq_inorder = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.data_pdu_inorder = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.erl = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.max_receive_data_len = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.first_burst_len = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.max_outstanding_r2t = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.max_burst_len = 0
Aug 26 11:41:03 user nova-compute[73068]: iface.chap_auth = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.bidi_chap = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.strict_login_compliance = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.discovery_auth = <empty>
Aug 26 11:41:03 user nova-compute[73068]: iface.discovery_logout = <empty>
Aug 26 11:41:03 user nova-compute[73068]: node.discovery_address = <empty>
Aug 26 11:41:03 user nova-compute[73068]: node.discovery_port = 0
Aug 26 11:41:03 user nova-compute[73068]: node.discovery_type = static
Aug 26 11:41:03 user nova-compute[73068]: node.session.initial_cmdsn = 0
Aug 26 11:41:03 user nova-compute[73068]: node.session.initial_login_retry_max = 8
Aug 26 11:41:03 user nova-compute[73068]: node.session.xmit_thread_priority = -20
Aug 26 11:41:03 user nova-compute[73068]: node.session.cmds_max = 128
Aug 26 11:41:03 user nova-compute[73068]: node.session.queue_depth = 32
Aug 26 11:41:03 user nova-compute[73068]: node.session.nr_sessions = 1
Aug 26 11:41:03 user nova-compute[73068]: node.session.auth.authmethod = CHAP
Aug 26 11:41:03 user nova-compute[73068]: node.session.auth.username = fEOmwvYr
Aug 26 11:41:03 user nova-compute[73068]: node.session.auth.password = ***
Aug 26 11:41:03 user nova-compute[73068]: node.session.auth.username_in = <empty>
Aug 26 11:41:03 user nova-compute[73068]: node.session.auth.password_in = <empty>
Aug 26 11:41:03 user nova-compute[73068]: node.session.auth.chap_algs = MD5
Aug 26 11:41:03 user nova-compute[73068]: node.session.timeo.replacement_timeout = 120
Aug 26 11:41:03 user nova-compute[73068]: node.session.err_timeo.abort_timeout = 15
Aug 26 11:41:03 user nova-compute[73068]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 11:41:03 user nova-compute[73068]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 11:41:03 user nova-compute[73068]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 11:41:03 user nova-compute[73068]: node.session.iscsi.FastAbort = Yes
Aug 26 11:41:03 user nova-compute[73068]: node.session.iscsi.InitialR2T = No
Aug 26 11:41:03 user nova-compute[73068]: node.session.iscsi.ImmediateData = Yes
Aug 26 11:41:03 user nova-compute[73068]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 11:41:03 user nova-compute[73068]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 11:41:03 user nova-compute[73068]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 11:41:03 user nova-compute[73068]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 11:41:03 user nova-compute[73068]: node.session.iscsi.MaxConnections = 1
Aug 26 11:41:03 user nova-compute[73068]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 11:41:03 user nova-compute[73068]: node.session.iscsi.ERL = 0
Aug 26 11:41:03 user nova-compute[73068]: node.session.scan = manual
Aug 26 11:41:03 user nova-compute[73068]: node.session.reopen_max = 0
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].address = 172.16.0.220
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].port = 3260
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].startup = manual
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].tcp.window_size = 524288
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].tcp.type_of_service = 0
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].timeo.logout_timeout = 15
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].timeo.login_timeout = 15
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].timeo.auth_timeout = 45
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].iscsi.DataDigest = None
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].iscsi.IFMarker = No
Aug 26 11:41:03 user nova-compute[73068]: node.conn[0].iscsi.OFMarker = No
Aug 26 11:41:03 user nova-compute[73068]: # END RECORD
Aug 26 11:41:03 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e51a84-5262-452c-a6e9-a747e075136c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "a86048fe-ddbb-49b3-b2da-8efc895346ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:03 user nova-compute[73068]: INFO nova.compute.manager [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Terminating instance
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d643c0-412c-46b3-b519-9da97b3cfd50]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEOmwvYr {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fEOmwvYr" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d85ec4e-8f67-4f94-b561-466b748d704d]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fEOmwvYr'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf66ee2e-5210-4673-9f39-51756b898f08]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a007bd-3878-4317-870a-3fc9b2ed0856]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:03 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:03 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:03 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.214s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] HCTL ('42', '0', '0', 0) found on session 16 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Scanning host 42 c: 0, t: 0, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7c6992-d849-4930-9b32-59726879d48f]: (4, ('0 0 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Searching for a device in session 16 and hctl ('42', '0', '0', 0) yield: sdk {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEOmwvYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.243s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] <== connect_volume: return (244ms) {'type': 'block', 'scsi_wwn': '23965383335313438', 'path': '/dev/sdk'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965383335313438', 'path': '/dev/sdk'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1968770570',display_name='tempest-ServerStableDeviceRescueTest-server-1968770570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1968770570',id=3,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANeDkCIfgF5NbRelSZtGfTmmKZCd893ZRa0qT/kWApiiF8kiY5NBEz60VroBFpV09CP67IhOPrec3jQOQpp9+8YbogTHVaRrAkokZk75Nc8REAUpIeu1QXyqQ4CF4sKWw==',key_name='tempest-keypair-2049648768',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbaaf8bfcebc433d899f65eb01b79426',ramdisk_id='',reservation_id='r-10gfaets',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-5310612',owner_user_name='tempest-ServerStableDeviceRescueTest-5310612-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:38:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b86976b16444b18f8af379585b27f7',uuid=2e64329a-4cf4-4f10-bbb9-4bb50754841a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "vif_mac": "fa:16:3e:f6:f1:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Converting VIF {"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "vif_mac": "fa:16:3e:f6:f1:f0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=633ed4fe-2630-42c2-b0ff-dba262056dad,network=Network(693a78d0-f114-4b5d-8504-687156dedb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633ed4fe-26') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.objects.instance [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.objects.base [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Object Instance<2e64329a-4cf4-4f10-bbb9-4bb50754841a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:41:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:41:03 user nova-compute[73068]:   <uuid>2e64329a-4cf4-4f10-bbb9-4bb50754841a</uuid>
Aug 26 11:41:03 user nova-compute[73068]:   <name>instance-00000003</name>
Aug 26 11:41:03 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:41:03 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:41:03 user nova-compute[73068]:   <metadata>
Aug 26 11:41:03 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:41:03 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:41:03 user nova-compute[73068]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1968770570</nova:name>
Aug 26 11:41:03 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:41:03</nova:creationTime>
Aug 26 11:41:03 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:41:03 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:41:03 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:41:03 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:41:03 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:41:03 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:41:03 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:41:03 user nova-compute[73068]:       <nova:owner>
Aug 26 11:41:03 user nova-compute[73068]:         <nova:user uuid="e4b86976b16444b18f8af379585b27f7">tempest-ServerStableDeviceRescueTest-5310612-project-member</nova:user>
Aug 26 11:41:03 user nova-compute[73068]:         <nova:project uuid="dbaaf8bfcebc433d899f65eb01b79426">tempest-ServerStableDeviceRescueTest-5310612</nova:project>
Aug 26 11:41:03 user nova-compute[73068]:       </nova:owner>
Aug 26 11:41:03 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:41:03 user nova-compute[73068]:       <nova:ports>
Aug 26 11:41:03 user nova-compute[73068]:         <nova:port uuid="633ed4fe-2630-42c2-b0ff-dba262056dad">
Aug 26 11:41:03 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 11:41:03 user nova-compute[73068]:         </nova:port>
Aug 26 11:41:03 user nova-compute[73068]:       </nova:ports>
Aug 26 11:41:03 user nova-compute[73068]:     </nova:instance>
Aug 26 11:41:03 user nova-compute[73068]:   </metadata>
Aug 26 11:41:03 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:41:03 user nova-compute[73068]:     <system>
Aug 26 11:41:03 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:41:03 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:41:03 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:41:03 user nova-compute[73068]:       <entry name="serial">2e64329a-4cf4-4f10-bbb9-4bb50754841a</entry>
Aug 26 11:41:03 user nova-compute[73068]:       <entry name="uuid">2e64329a-4cf4-4f10-bbb9-4bb50754841a</entry>
Aug 26 11:41:03 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:41:03 user nova-compute[73068]:     </system>
Aug 26 11:41:03 user nova-compute[73068]:   </sysinfo>
Aug 26 11:41:03 user nova-compute[73068]:   <os>
Aug 26 11:41:03 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:41:03 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:41:03 user nova-compute[73068]:   </os>
Aug 26 11:41:03 user nova-compute[73068]:   <features>
Aug 26 11:41:03 user nova-compute[73068]:     <acpi/>
Aug 26 11:41:03 user nova-compute[73068]:     <apic/>
Aug 26 11:41:03 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:41:03 user nova-compute[73068]:   </features>
Aug 26 11:41:03 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:41:03 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:41:03 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:41:03 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:41:03 user nova-compute[73068]:   </clock>
Aug 26 11:41:03 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:41:03 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:41:03 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:41:03 user nova-compute[73068]:   </cpu>
Aug 26 11:41:03 user nova-compute[73068]:   <devices>
Aug 26 11:41:03 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:41:03 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:41:03 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk"/>
Aug 26 11:41:03 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:41:03 user nova-compute[73068]:     </disk>
Aug 26 11:41:03 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:41:03 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:41:03 user nova-compute[73068]:       <source dev="/dev/sdk"/>
Aug 26 11:41:03 user nova-compute[73068]:       <target dev="vdb" bus="virtio"/>
Aug 26 11:41:03 user nova-compute[73068]:       <serial>9e986a9e-fe7b-40a5-9e70-d65765ceef6c</serial>
Aug 26 11:41:03 user nova-compute[73068]:     </disk>
Aug 26 11:41:03 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:41:03 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:41:03 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.rescue"/>
Aug 26 11:41:03 user nova-compute[73068]:       <target dev="vdc" bus="virtio"/>
Aug 26 11:41:03 user nova-compute[73068]:       <boot order="1"/>
Aug 26 11:41:03 user nova-compute[73068]:     </disk>
Aug 26 11:41:03 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:41:03 user nova-compute[73068]:       <mac address="fa:16:3e:f6:f1:f0"/>
Aug 26 11:41:03 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:41:03 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:41:03 user nova-compute[73068]:       <target dev="tap633ed4fe-26"/>
Aug 26 11:41:03 user nova-compute[73068]:     </interface>
Aug 26 11:41:03 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:41:03 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/console.log" append="off"/>
Aug 26 11:41:03 user nova-compute[73068]:     </serial>
Aug 26 11:41:03 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:41:03 user nova-compute[73068]:     <video>
Aug 26 11:41:03 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:41:03 user nova-compute[73068]:     </video>
Aug 26 11:41:03 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:41:03 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:41:03 user nova-compute[73068]:     </rng>
Aug 26 11:41:03 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:41:03 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:41:03 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:41:03 user nova-compute[73068]:     </memballoon>
Aug 26 11:41:03 user nova-compute[73068]:   </devices>
Aug 26 11:41:03 user nova-compute[73068]: </domain>
Aug 26 11:41:03 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:41:03 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Instance destroyed successfully.
Aug 26 11:41:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:41:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:41:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:41:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] No VIF found with MAC fa:16:3e:f6:f1:f0, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:41:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:04 user nova-compute[73068]: DEBUG nova.network.neutron [req-09d44ccc-7911-481d-8758-46b279dc30ca req-b8df17ba-46e2-4c11-9850-632c16ba4456 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Updated VIF entry in instance network info cache for port 47d313d2-edb6-4cb5-8739-505b93a3c024. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:41:04 user nova-compute[73068]: DEBUG nova.network.neutron [req-09d44ccc-7911-481d-8758-46b279dc30ca req-b8df17ba-46e2-4c11-9850-632c16ba4456 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Updating instance_info_cache with network_info: [{"id": "47d313d2-edb6-4cb5-8739-505b93a3c024", "address": "fa:16:3e:b0:c9:24", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d313d2-ed", "ovs_interfaceid": "47d313d2-edb6-4cb5-8739-505b93a3c024", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-09d44ccc-7911-481d-8758-46b279dc30ca req-b8df17ba-46e2-4c11-9850-632c16ba4456 service nova] Releasing lock "refresh_cache-a86048fe-ddbb-49b3-b2da-8efc895346ba" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:41:05 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Instance destroyed successfully.
Aug 26 11:41:05 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'resources' on Instance uuid a86048fe-ddbb-49b3-b2da-8efc895346ba {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688511533',display_name='tempest-AttachVolumeNegativeTest-server-688511533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688511533',id=13,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp/+v/GYAXkEO2Pz8iTkGQ/GylkhdnMvHFpXYw+qSEopj6BE8vHfCpC6Qk/LqFgW8MtdATtObwmMDe/e+iAPHOfcWZ/tEn6DYH3fDhymx99UgcjFHmy8RK9Se+r8FhTXw==',key_name='tempest-keypair-882447336',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-e4of5lhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=a86048fe-ddbb-49b3-b2da-8efc895346ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47d313d2-edb6-4cb5-8739-505b93a3c024", "address": "fa:16:3e:b0:c9:24", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d313d2-ed", "ovs_interfaceid": "47d313d2-edb6-4cb5-8739-505b93a3c024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "47d313d2-edb6-4cb5-8739-505b93a3c024", "address": "fa:16:3e:b0:c9:24", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47d313d2-ed", "ovs_interfaceid": "47d313d2-edb6-4cb5-8739-505b93a3c024", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c9:24,bridge_name='br-int',has_traffic_filtering=True,id=47d313d2-edb6-4cb5-8739-505b93a3c024,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d313d2-ed') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG os_vif [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c9:24,bridge_name='br-int',has_traffic_filtering=True,id=47d313d2-edb6-4cb5-8739-505b93a3c024,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d313d2-ed') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47d313d2-ed, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: INFO os_vif [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:c9:24,bridge_name='br-int',has_traffic_filtering=True,id=47d313d2-edb6-4cb5-8739-505b93a3c024,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47d313d2-ed')
Aug 26 11:41:05 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Deleting instance files /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba_del
Aug 26 11:41:05 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Deletion of /opt/stack/data/nova/instances/a86048fe-ddbb-49b3-b2da-8efc895346ba_del complete
Aug 26 11:41:05 user nova-compute[73068]: INFO nova.compute.manager [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Took 1.69 seconds to destroy the instance on the hypervisor.
Aug 26 11:41:05 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:05 user nova-compute[73068]: INFO nova.compute.manager [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Terminating instance
Aug 26 11:41:05 user nova-compute[73068]: DEBUG nova.compute.manager [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-4cc458a6-d051-46f1-b999-defc811fa0ad req-8a4a6628-1ed6-4d79-ac23-5d54ddfe600c service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4cc458a6-d051-46f1-b999-defc811fa0ad req-8a4a6628-1ed6-4d79-ac23-5d54ddfe600c service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4cc458a6-d051-46f1-b999-defc811fa0ad req-8a4a6628-1ed6-4d79-ac23-5d54ddfe600c service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4cc458a6-d051-46f1-b999-defc811fa0ad req-8a4a6628-1ed6-4d79-ac23-5d54ddfe600c service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-4cc458a6-d051-46f1-b999-defc811fa0ad req-8a4a6628-1ed6-4d79-ac23-5d54ddfe600c service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:06 user nova-compute[73068]: WARNING nova.compute.manager [req-4cc458a6-d051-46f1-b999-defc811fa0ad req-8a4a6628-1ed6-4d79-ac23-5d54ddfe600c service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received unexpected event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with vm_state active and task_state rescuing.
Aug 26 11:41:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-0a697798-55cd-42b5-a9a0-e2c929b6e28d req-abdcf7f1-9511-4b34-b20a-77a6419dccd3 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Received event network-vif-unplugged-47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0a697798-55cd-42b5-a9a0-e2c929b6e28d req-abdcf7f1-9511-4b34-b20a-77a6419dccd3 service nova] Acquiring lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0a697798-55cd-42b5-a9a0-e2c929b6e28d req-abdcf7f1-9511-4b34-b20a-77a6419dccd3 service nova] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0a697798-55cd-42b5-a9a0-e2c929b6e28d req-abdcf7f1-9511-4b34-b20a-77a6419dccd3 service nova] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-0a697798-55cd-42b5-a9a0-e2c929b6e28d req-abdcf7f1-9511-4b34-b20a-77a6419dccd3 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] No waiting events found dispatching network-vif-unplugged-47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-0a697798-55cd-42b5-a9a0-e2c929b6e28d req-abdcf7f1-9511-4b34-b20a-77a6419dccd3 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Received event network-vif-unplugged-47d313d2-edb6-4cb5-8739-505b93a3c024 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Took 1.61 seconds to deallocate network for instance.
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-e27ea2cc-c282-4401-8efe-2d8f00f57dd9 req-cb7280a1-6dc6-4015-ad46-479b9a60be09 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e27ea2cc-c282-4401-8efe-2d8f00f57dd9 req-cb7280a1-6dc6-4015-ad46-479b9a60be09 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e27ea2cc-c282-4401-8efe-2d8f00f57dd9 req-cb7280a1-6dc6-4015-ad46-479b9a60be09 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e27ea2cc-c282-4401-8efe-2d8f00f57dd9 req-cb7280a1-6dc6-4015-ad46-479b9a60be09 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-e27ea2cc-c282-4401-8efe-2d8f00f57dd9 req-cb7280a1-6dc6-4015-ad46-479b9a60be09 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-unplugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-e27ea2cc-c282-4401-8efe-2d8f00f57dd9 req-cb7280a1-6dc6-4015-ad46-479b9a60be09 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Instance destroyed successfully.
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.objects.instance [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lazy-loading 'resources' on Instance uuid 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:09:4e,bridge_name='br-int',has_traffic_filtering=True,id=0627ade3-5789-4bab-8e59-684ca2e6b871,network=Network(81cd492b-d44a-49d5-a375-15ca08c663e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0627ade3-57') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:09:4e,bridge_name='br-int',has_traffic_filtering=True,id=0627ade3-5789-4bab-8e59-684ca2e6b871,network=Network(81cd492b-d44a-49d5-a375-15ca08c663e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0627ade3-57') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0627ade3-57, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: INFO os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:09:4e,bridge_name='br-int',has_traffic_filtering=True,id=0627ade3-5789-4bab-8e59-684ca2e6b871,network=Network(81cd492b-d44a-49d5-a375-15ca08c663e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0627ade3-57')
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:d3:75,bridge_name='br-int',has_traffic_filtering=True,id=542f57ca-0e66-4492-a4d5-1fbbd78d5a3d,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap542f57ca-0e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d3:75,bridge_name='br-int',has_traffic_filtering=True,id=542f57ca-0e66-4492-a4d5-1fbbd78d5a3d,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap542f57ca-0e') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap542f57ca-0e, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: INFO os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:d3:75,bridge_name='br-int',has_traffic_filtering=True,id=542f57ca-0e66-4492-a4d5-1fbbd78d5a3d,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap542f57ca-0e')
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:c2:07,bridge_name='br-int',has_traffic_filtering=True,id=4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a1c39f9-cc') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:c2:07,bridge_name='br-int',has_traffic_filtering=True,id=4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a1c39f9-cc') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a1c39f9-cc, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.759s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: INFO os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:c2:07,bridge_name='br-int',has_traffic_filtering=True,id=4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a1c39f9-cc')
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=23a55e92-430b-4393-8957-cfc9dce489be,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a55e92-43') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=23a55e92-430b-4393-8957-cfc9dce489be,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a55e92-43') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23a55e92-43, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:07 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Deleted allocations for instance a86048fe-ddbb-49b3-b2da-8efc895346ba
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: INFO os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:17:ac,bridge_name='br-int',has_traffic_filtering=True,id=23a55e92-430b-4393-8957-cfc9dce489be,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23a55e92-43')
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d6:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b676f78-696f-4ef3-8529-a3892bf0aeb1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b676f78-69') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d6:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b676f78-696f-4ef3-8529-a3892bf0aeb1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b676f78-69') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b676f78-69, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:08 user nova-compute[73068]: INFO os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:d6:e1,bridge_name='br-int',has_traffic_filtering=True,id=3b676f78-696f-4ef3-8529-a3892bf0aeb1,network=Network(97a5ae4c-4433-4457-b117-0c0c8685a268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b676f78-69')
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d2:2c,bridge_name='br-int',has_traffic_filtering=True,id=c1f2ea89-5b9c-46ba-a9a9-16e75263b153,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f2ea89-5b') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d2:2c,bridge_name='br-int',has_traffic_filtering=True,id=c1f2ea89-5b9c-46ba-a9a9-16e75263b153,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f2ea89-5b') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1f2ea89-5b, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:08 user nova-compute[73068]: INFO os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:d2:2c,bridge_name='br-int',has_traffic_filtering=True,id=c1f2ea89-5b9c-46ba-a9a9-16e75263b153,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1f2ea89-5b')
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-480879360',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-480879360',id=10,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpaZl3zg6mMR1LlAmWP5TpzkyUwzJCt3WFcbZzr6F0fY5azDBMC4plAnrqHMmpx4vSaZfNR/FAeMPzKGRWxqsarDyXIe0npBwCtbTqRBu+kbV11/OwSe50wZmkVKPWHqQ==',key_name='tempest-keypair-121961356',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39175659a66542958d7d93274ee45cde',ramdisk_id='',reservation_id='r-hjn5t65s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1872630429',owner_user_name='tempest-TaggedBootDevicesTest-1872630429-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f47dcfe8a74fe1a7138cb072f4dc3c',uuid=8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converting VIF {"id": "9106173f-4454-446d-a434-3222ed390edf", "address": "fa:16:3e:4a:14:90", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9106173f-44", "ovs_interfaceid": "9106173f-4454-446d-a434-3222ed390edf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:14:90,bridge_name='br-int',has_traffic_filtering=True,id=9106173f-4454-446d-a434-3222ed390edf,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9106173f-44') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:14:90,bridge_name='br-int',has_traffic_filtering=True,id=9106173f-4454-446d-a434-3222ed390edf,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9106173f-44') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9106173f-44, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a24d20f6-1c7c-470c-86c8-35cfe888f2c3 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.378s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:08 user nova-compute[73068]: INFO os_vif [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:14:90,bridge_name='br-int',has_traffic_filtering=True,id=9106173f-4454-446d-a434-3222ed390edf,network=Network(579c176c-d299-4ce5-9858-5b85c0be37f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9106173f-44')
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USaiJjrM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:41:08 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9db6d34-f211-4105-b9e3-594127e3134c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c11467-bbbd-4d7b-868e-523cb9707f66]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb0434430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659'): ({'sde'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Removing single pathed devices sde {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d785be5-c9fb-48ef-93c1-3bb69e99f52a]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a0e9cf-2286-403b-a503-6d03616ed060]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Flushing IO for device /dev/sde {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e1d202-9671-4857-a5a8-614312d5b668]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a165bca5-2e18-4f63-a71f-abd02804ce83]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] SCSI volumes sde have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4207f0-1510-4d10-924e-3ee9ccb10ff3]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[27801127-c728-4760-8746-af28fe5ffb2f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:08 user nova-compute[73068]: WARNING nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received unexpected event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with vm_state active and task_state rescuing.
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Received event network-vif-deleted-47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-unplugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:08 user nova-compute[73068]: WARNING nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1 for instance with vm_state active and task_state deleting.
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-unplugged-23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-23a55e92-430b-4393-8957-cfc9dce489be for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:08 user nova-compute[73068]: WARNING nova.compute.manager [req-856e6820-1db4-46d4-ba11-5366a35ad6a6 req-86768c46-b254-44e3-8c63-cf48940a0462 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-23a55e92-430b-4393-8957-cfc9dce489be for instance with vm_state active and task_state deleting.
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659, portal: 172.16.0.220,3260]
Aug 26 11:41:08 user nova-compute[73068]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659, portal: 172.16.0.220,3260] successful.
Aug 26 11:41:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-e200d0d0-9c37-4675-9102-3a0ffeb2e4db req-c79ad37a-834e-436e-adce-9e695d086e21 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Received event network-vif-plugged-47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e200d0d0-9c37-4675-9102-3a0ffeb2e4db req-c79ad37a-834e-436e-adce-9e695d086e21 service nova] Acquiring lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e200d0d0-9c37-4675-9102-3a0ffeb2e4db req-c79ad37a-834e-436e-adce-9e695d086e21 service nova] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e200d0d0-9c37-4675-9102-3a0ffeb2e4db req-c79ad37a-834e-436e-adce-9e695d086e21 service nova] Lock "a86048fe-ddbb-49b3-b2da-8efc895346ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-e200d0d0-9c37-4675-9102-3a0ffeb2e4db req-c79ad37a-834e-436e-adce-9e695d086e21 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] No waiting events found dispatching network-vif-plugged-47d313d2-edb6-4cb5-8739-505b93a3c024 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:08 user nova-compute[73068]: WARNING nova.compute.manager [req-e200d0d0-9c37-4675-9102-3a0ffeb2e4db req-c79ad37a-834e-436e-adce-9e695d086e21 service nova] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Received unexpected event network-vif-plugged-47d313d2-edb6-4cb5-8739-505b93a3c024 for instance with vm_state deleted and task_state None.
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f899d0b-2948-4afd-a7d7-4b0166a31659 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fc5fa5-020a-4c58-a00a-01c03aed7609]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] <== disconnect_volume: return (384ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYyVzbpT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:41:08 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d701dc4-a66a-48d7-aa86-631fde5e300b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[21818dfa-77c3-47e5-b2dd-d9ff37221926]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:08 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd905be170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for 2e64329a-4cf4-4f10-bbb9-4bb50754841a due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050068.5953028, 2e64329a-4cf4-4f10-bbb9-4bb50754841a => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:41:08 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] VM Resumed (Lifecycle Event)
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-c24e2741-26ea-444f-b824-a88c9e9e5757 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6685309-f4fa-4457-bc85-b0096512c10d]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f964ae-9dc2-4414-ab15-2f11d408103b]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050068.5967934, 2e64329a-4cf4-4f10-bbb9-4bb50754841a => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:41:08 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] VM Started (Lifecycle Event)
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3157d4-cebc-4e9e-83cc-876a15ffcef6]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.152s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dafc70f-ddca-4960-863f-d69fa6c8b62e]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:08 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.097s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9457aac-1c85-447e-ad7b-14b42e357bf2]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5554cdc-0cdb-4d2e-96c2-f33c88faf575]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63, portal: 172.16.0.220,3260]
Aug 26 11:41:09 user nova-compute[73068]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63, portal: 172.16.0.220,3260] successful.
Aug 26 11:41:09 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cd96df1-c124-47d4-a50f-24916b465e63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[45455b74-3042-41cc-bdad-644bbd459691]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.627s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] <== disconnect_volume: return (628ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIDQWyOG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:41:09 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be2eb59-1799-46eb-91ea-ec0ba5fdb083]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c490b98-734f-47ed-9dbf-c83b5d7216ff]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:09 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:09 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:09 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb0378550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d'): ({'sdd'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Removing single pathed devices sdd {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[27427ec8-dbe1-4b43-b9ce-0e0d7ce31230]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b24157-f636-43a6-8152-7a2f163651a7]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Flushing IO for device /dev/sdd {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0b4b57-c3a7-4086-9048-9f280e38c22f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9fc01-691b-43db-91df-fb09b0247ebb]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dbfd1b-88ce-4fe6-817e-675c50dd3f2f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb1aad5-3cb5-4722-8762-a8519f3fdcb2]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d, portal: 172.16.0.220,3260]
Aug 26 11:41:09 user nova-compute[73068]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d, portal: 172.16.0.220,3260] successful.
Aug 26 11:41:09 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG nova.compute.manager [req-7df1894e-fd5c-4741-a571-30628ee218a3 req-1189f4c3-9877-494b-9cff-281c243080de service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7df1894e-fd5c-4741-a571-30628ee218a3 req-1189f4c3-9877-494b-9cff-281c243080de service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7df1894e-fd5c-4741-a571-30628ee218a3 req-1189f4c3-9877-494b-9cff-281c243080de service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7df1894e-fd5c-4741-a571-30628ee218a3 req-1189f4c3-9877-494b-9cff-281c243080de service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG nova.compute.manager [req-7df1894e-fd5c-4741-a571-30628ee218a3 req-1189f4c3-9877-494b-9cff-281c243080de service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:09 user nova-compute[73068]: WARNING nova.compute.manager [req-7df1894e-fd5c-4741-a571-30628ee218a3 req-1189f4c3-9877-494b-9cff-281c243080de service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-3b676f78-696f-4ef3-8529-a3892bf0aeb1 for instance with vm_state active and task_state deleting.
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1da6ab8-9518-4dfa-be22-538d76200b8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e78af00-d40e-4489-8eaf-985528b3968b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] <== disconnect_volume: return (397ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:41:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Deleting instance files /opt/stack/data/nova/instances/8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8_del
Aug 26 11:41:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Deletion of /opt/stack/data/nova/instances/8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8_del complete
Aug 26 11:41:09 user nova-compute[73068]: INFO nova.compute.manager [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Took 4.16 seconds to destroy the instance on the hypervisor.
Aug 26 11:41:09 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:41:09 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lazy-loading 'flavor' on Instance uuid 2881e7a6-0099-4b87-819b-c36dd3db99c8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:10 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Ignoring supplied device name: /dev/vdb
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:10 user nova-compute[73068]: INFO nova.compute.manager [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Attaching volume 377fc6be-01f4-4523-8775-06c396ae0528 to /dev/vdb
Aug 26 11:41:10 user nova-compute[73068]: DEBUG os_brick.utils [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e98001d-5da3-4270-8014-7089d60111e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[178768f3-82ad-43f0-951f-e37ed98d4fe0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-unplugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:10 user nova-compute[73068]: WARNING nova.compute.manager [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 for instance with vm_state active and task_state deleting.
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-unplugged-9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-9611015d-3791-4fa7-8c9d-e62c75e61aad req-4ed81a93-13ff-4833-8bd9-44303ff22613 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-9106173f-4454-446d-a434-3222ed390edf for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf004b43-0394-4c42-949d-3fe7d2bcca6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8379a41-ecb9-4ffa-bd33-ab4a7c2e43ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-9dd7cb10-d979-4781-bab6-5b9448b40138 req-fc3fe7b2-ee43-4215-9d4e-3a3d26f2d1d6 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-changed-13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-9dd7cb10-d979-4781-bab6-5b9448b40138 req-fc3fe7b2-ee43-4215-9d4e-3a3d26f2d1d6 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing instance network info cache due to event network-changed-13c74443-704c-42ea-a6c9-318fdb45bf39. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9dd7cb10-d979-4781-bab6-5b9448b40138 req-fc3fe7b2-ee43-4215-9d4e-3a3d26f2d1d6 service nova] Acquiring lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9dd7cb10-d979-4781-bab6-5b9448b40138 req-fc3fe7b2-ee43-4215-9d4e-3a3d26f2d1d6 service nova] Acquired lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.network.neutron [req-9dd7cb10-d979-4781-bab6-5b9448b40138 req-fc3fe7b2-ee43-4215-9d4e-3a3d26f2d1d6 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Refreshing network info cache for port 13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:41:10 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:41:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9970a2-67a3-4a91-9b08-6e59040c7c40]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG os_brick.utils [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:41:10 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Updating existing volume attachment record: 36a379b3-8b91-4d00-92c5-862e94dc4065 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:41:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-9dd7cb10-d979-4781-bab6-5b9448b40138 req-fc3fe7b2-ee43-4215-9d4e-3a3d26f2d1d6 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updated VIF entry in instance network info cache for port 13c74443-704c-42ea-a6c9-318fdb45bf39. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:41:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-9dd7cb10-d979-4781-bab6-5b9448b40138 req-fc3fe7b2-ee43-4215-9d4e-3a3d26f2d1d6 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [{"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9dd7cb10-d979-4781-bab6-5b9448b40138 req-fc3fe7b2-ee43-4215-9d4e-3a3d26f2d1d6 service nova] Releasing lock "refresh_cache-23af7614-b27e-4e97-8180-5289cf8d9bcc" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:41:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-7990ee17-7580-446c-a998-bd577598c3fb req-9497556b-960d-44a8-b50d-2ab08790a1c4 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Received event network-changed-e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-7990ee17-7580-446c-a998-bd577598c3fb req-9497556b-960d-44a8-b50d-2ab08790a1c4 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Refreshing instance network info cache due to event network-changed-e8697f9a-2cd5-412b-b54a-7ca067065d94. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:41:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7990ee17-7580-446c-a998-bd577598c3fb req-9497556b-960d-44a8-b50d-2ab08790a1c4 service nova] Acquiring lock "refresh_cache-2881e7a6-0099-4b87-819b-c36dd3db99c8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:41:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7990ee17-7580-446c-a998-bd577598c3fb req-9497556b-960d-44a8-b50d-2ab08790a1c4 service nova] Acquired lock "refresh_cache-2881e7a6-0099-4b87-819b-c36dd3db99c8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:41:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-7990ee17-7580-446c-a998-bd577598c3fb req-9497556b-960d-44a8-b50d-2ab08790a1c4 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Refreshing network info cache for port e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:41:12 user nova-compute[73068]: DEBUG nova.network.neutron [req-7990ee17-7580-446c-a998-bd577598c3fb req-9497556b-960d-44a8-b50d-2ab08790a1c4 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Updated VIF entry in instance network info cache for port e8697f9a-2cd5-412b-b54a-7ca067065d94. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:41:12 user nova-compute[73068]: DEBUG nova.network.neutron [req-7990ee17-7580-446c-a998-bd577598c3fb req-9497556b-960d-44a8-b50d-2ab08790a1c4 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Updating instance_info_cache with network_info: [{"id": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "address": "fa:16:3e:89:c9:f1", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8697f9a-2c", "ovs_interfaceid": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7990ee17-7580-446c-a998-bd577598c3fb req-9497556b-960d-44a8-b50d-2ab08790a1c4 service nova] Releasing lock "refresh_cache-2881e7a6-0099-4b87-819b-c36dd3db99c8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:41:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-507ad7dd-425d-4d40-acd1-9c5b676806a2 req-a8e937d6-0310-4f27-ac95-1b029efda0c9 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-507ad7dd-425d-4d40-acd1-9c5b676806a2 req-a8e937d6-0310-4f27-ac95-1b029efda0c9 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-507ad7dd-425d-4d40-acd1-9c5b676806a2 req-a8e937d6-0310-4f27-ac95-1b029efda0c9 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-507ad7dd-425d-4d40-acd1-9c5b676806a2 req-a8e937d6-0310-4f27-ac95-1b029efda0c9 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-507ad7dd-425d-4d40-acd1-9c5b676806a2 req-a8e937d6-0310-4f27-ac95-1b029efda0c9 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:12 user nova-compute[73068]: WARNING nova.compute.manager [req-507ad7dd-425d-4d40-acd1-9c5b676806a2 req-a8e937d6-0310-4f27-ac95-1b029efda0c9 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-9106173f-4454-446d-a434-3222ed390edf for instance with vm_state active and task_state deleting.
Aug 26 11:41:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:13 user nova-compute[73068]: INFO nova.compute.manager [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Terminating instance
Aug 26 11:41:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-6c081f13-7b1c-42f9-a6bd-c966806c1216 req-478ffb34-39c7-488a-98cc-1ee9ae929ab5 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6c081f13-7b1c-42f9-a6bd-c966806c1216 req-478ffb34-39c7-488a-98cc-1ee9ae929ab5 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6c081f13-7b1c-42f9-a6bd-c966806c1216 req-478ffb34-39c7-488a-98cc-1ee9ae929ab5 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6c081f13-7b1c-42f9-a6bd-c966806c1216 req-478ffb34-39c7-488a-98cc-1ee9ae929ab5 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-6c081f13-7b1c-42f9-a6bd-c966806c1216 req-478ffb34-39c7-488a-98cc-1ee9ae929ab5 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-unplugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-6c081f13-7b1c-42f9-a6bd-c966806c1216 req-478ffb34-39c7-488a-98cc-1ee9ae929ab5 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-b94e0a39-ee95-461a-8c00-d475c55db271 req-769df210-8e0d-4957-b9b5-1417638376b2 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b94e0a39-ee95-461a-8c00-d475c55db271 req-769df210-8e0d-4957-b9b5-1417638376b2 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b94e0a39-ee95-461a-8c00-d475c55db271 req-769df210-8e0d-4957-b9b5-1417638376b2 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b94e0a39-ee95-461a-8c00-d475c55db271 req-769df210-8e0d-4957-b9b5-1417638376b2 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-b94e0a39-ee95-461a-8c00-d475c55db271 req-769df210-8e0d-4957-b9b5-1417638376b2 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-unplugged-0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-b94e0a39-ee95-461a-8c00-d475c55db271 req-769df210-8e0d-4957-b9b5-1417638376b2 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-unplugged-0627ade3-5789-4bab-8e59-684ca2e6b871 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-deleted-9106173f-4454-446d-a434-3222ed390edf {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:14 user nova-compute[73068]: INFO nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Neutron deleted interface 9106173f-4454-446d-a434-3222ed390edf; detaching it from the instance and deleting it from the info cache
Aug 26 11:41:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [{"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "23a55e92-430b-4393-8957-cfc9dce489be", "address": "fa:16:3e:df:17:ac", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23a55e92-43", "ovs_interfaceid": "23a55e92-430b-4393-8957-cfc9dce489be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Detach interface failed, port_id=9106173f-4454-446d-a434-3222ed390edf, reason: Instance 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-7d526e58-f0c8-4959-a451-267b715b2eff {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-unplugged-7d526e58-f0c8-4959-a451-267b715b2eff {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-7d526e58-f0c8-4959-a451-267b715b2eff for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-deleted-23a55e92-430b-4393-8957-cfc9dce489be {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:14 user nova-compute[73068]: INFO nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Neutron deleted interface 23a55e92-430b-4393-8957-cfc9dce489be; detaching it from the instance and deleting it from the info cache
Aug 26 11:41:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [{"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "address": "fa:16:3e:b9:d2:2c", "network": {"id": "579c176c-d299-4ce5-9858-5b85c0be37f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-2121909678", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1f2ea89-5b", "ovs_interfaceid": "c1f2ea89-5b9c-46ba-a9a9-16e75263b153", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Detach interface failed, port_id=23a55e92-430b-4393-8957-cfc9dce489be, reason: Instance 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-7d526e58-f0c8-4959-a451-267b715b2eff {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-7d526e58-f0c8-4959-a451-267b715b2eff {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:15 user nova-compute[73068]: WARNING nova.compute.manager [req-90d1f697-22d0-4d5f-ad7b-4244b8409ee3 req-252b5a3d-e0e7-43fe-a5e6-c99ef50c8cde service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-7d526e58-f0c8-4959-a451-267b715b2eff for instance with vm_state active and task_state deleting.
Aug 26 11:41:15 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Instance destroyed successfully.
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lazy-loading 'resources' on Instance uuid 23af7614-b27e-4e97-8180-5289cf8d9bcc {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:f0:f0,bridge_name='br-int',has_traffic_filtering=True,id=13c74443-704c-42ea-a6c9-318fdb45bf39,network=Network(30547f21-ccab-478e-9b3a-10ed8863f9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c74443-70') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:f0:f0,bridge_name='br-int',has_traffic_filtering=True,id=13c74443-704c-42ea-a6c9-318fdb45bf39,network=Network(30547f21-ccab-478e-9b3a-10ed8863f9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c74443-70') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13c74443-70, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: INFO os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:f0:f0,bridge_name='br-int',has_traffic_filtering=True,id=13c74443-704c-42ea-a6c9-318fdb45bf39,network=Network(30547f21-ccab-478e-9b3a-10ed8863f9e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c74443-70')
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=b8349c53-2931-4166-9c38-83acbd21a526,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8349c53-29') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=b8349c53-2931-4166-9c38-83acbd21a526,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8349c53-29') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8349c53-29, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: INFO os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:00:f3,bridge_name='br-int',has_traffic_filtering=True,id=b8349c53-2931-4166-9c38-83acbd21a526,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb8349c53-29')
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f3:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d526e58-f0c8-4959-a451-267b715b2eff,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d526e58-f0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f3:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d526e58-f0c8-4959-a451-267b715b2eff,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d526e58-f0') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d526e58-f0, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: INFO os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:f3:a1,bridge_name='br-int',has_traffic_filtering=True,id=7d526e58-f0c8-4959-a451-267b715b2eff,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7d526e58-f0')
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:d9,bridge_name='br-int',has_traffic_filtering=True,id=e9c95ec3-dbcc-4eb5-8787-788c1ea7d118,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c95ec3-db') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:d9,bridge_name='br-int',has_traffic_filtering=True,id=e9c95ec3-dbcc-4eb5-8787-788c1ea7d118,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c95ec3-db') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9c95ec3-db, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: INFO os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:63:d9,bridge_name='br-int',has_traffic_filtering=True,id=e9c95ec3-dbcc-4eb5-8787-788c1ea7d118,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c95ec3-db')
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d5:47,bridge_name='br-int',has_traffic_filtering=True,id=10b083eb-5813-4a51-8e7d-9fd1afbdd97b,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b083eb-58') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d5:47,bridge_name='br-int',has_traffic_filtering=True,id=10b083eb-5813-4a51-8e7d-9fd1afbdd97b,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b083eb-58') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10b083eb-58, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: INFO os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:d5:47,bridge_name='br-int',has_traffic_filtering=True,id=10b083eb-5813-4a51-8e7d-9fd1afbdd97b,network=Network(4911313b-680d-460f-bcd7-a6d3a79e2308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b083eb-58')
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "27a00e05-7181-4d39-92ab-121218d84e48", "address": "fa:16:3e:e4:26:3f", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a00e05-71", "ovs_interfaceid": "27a00e05-7181-4d39-92ab-121218d84e48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:26:3f,bridge_name='br-int',has_traffic_filtering=True,id=27a00e05-7181-4d39-92ab-121218d84e48,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a00e05-71') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:26:3f,bridge_name='br-int',has_traffic_filtering=True,id=27a00e05-7181-4d39-92ab-121218d84e48,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a00e05-71') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27a00e05-71, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: INFO os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:26:3f,bridge_name='br-int',has_traffic_filtering=True,id=27a00e05-7181-4d39-92ab-121218d84e48,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a00e05-71')
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1565346184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1565346184',id=11,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNS/w5IWv4QHYDEU9fr+n5cOvdVPoY0tSlkv6JauFDFBZtyQaFuaORTAE8j4VsM5qd9lYrkTRWnc5YQEhJHafXVQ2w1O0m2SPStTXcz0lGz5G1EZxcJ+RucQHdgmi4zsUw==',key_name='tempest-keypair-294641443',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3d06304213c49a58e2896200963e7f4',ramdisk_id='',reservation_id='r-nxtqydi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-760066924',owner_user_name='tempest-TaggedBootDevicesTest_v242-760066924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f8b15786de34d59b9d0b2f061640b56',uuid=23af7614-b27e-4e97-8180-5289cf8d9bcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converting VIF {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=6063758d-5a93-4b48-9d31-fad4e01a7e9c,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063758d-5a') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=6063758d-5a93-4b48-9d31-fad4e01a7e9c,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063758d-5a') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6063758d-5a, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:15 user nova-compute[73068]: INFO os_vif [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=6063758d-5a93-4b48-9d31-fad4e01a7e9c,network=Network(a7856263-1844-4970-b044-e14c0a0625b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6063758d-5a')
Aug 26 11:41:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUKLZMSY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:41:15 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.033s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f66407-0e6a-40d9-99b6-92bbd9077b0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e0ff71-8b9e-4eea-8a2f-d0033e3fe6ee]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:15 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:15 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:15 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9039b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914'): ({'sdg'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Removing single pathed devices sdg {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[08134079-d598-41a8-94cb-fe467983abaf]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e126ac10-0c12-45e9-9fe8-5329d2fb0f4d]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Flushing IO for device /dev/sdg {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d1283a-f714-4e4c-865b-2866f6d61b5b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[21881a08-3f2c-474a-bc7c-063b3c3e21f8]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] SCSI volumes sdg have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e1c246-1497-420a-bb51-bfcb31ded016]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[491c3e44-f7e1-4806-9428-da9623dff42c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914, portal: 172.16.0.220,3260]
Aug 26 11:41:16 user nova-compute[73068]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914, portal: 172.16.0.220,3260] successful.
Aug 26 11:41:16 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ae7a199-f84b-49aa-9543-be68e4b9e914 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[39de71e8-68c7-4721-98e8-2265ef723f99]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] <== disconnect_volume: return (376ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:16 user nova-compute[73068]: WARNING nova.compute.manager [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 for instance with vm_state active and task_state deleting.
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-unplugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:16 user nova-compute[73068]: WARNING nova.compute.manager [req-3d5f3792-667b-49c9-a34a-1be46c87d070 req-40bd589d-7c43-471e-a6b5-96a2316a28ad service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-6063758d-5a93-4b48-9d31-fad4e01a7e9c for instance with vm_state active and task_state deleting.
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-plugged-0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Acquiring lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] No waiting events found dispatching network-vif-plugged-0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:16 user nova-compute[73068]: WARNING nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received unexpected event network-vif-plugged-0627ade3-5789-4bab-8e59-684ca2e6b871 for instance with vm_state active and task_state deleting.
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-unplugged-13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-13c74443-704c-42ea-a6c9-318fdb45bf39 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:16 user nova-compute[73068]: WARNING nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-13c74443-704c-42ea-a6c9-318fdb45bf39 for instance with vm_state active and task_state deleting.
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-b8349c53-2931-4166-9c38-83acbd21a526 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-unplugged-b8349c53-2931-4166-9c38-83acbd21a526 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-826a2d99-ff4b-4a5d-b312-0bf813616864 req-924e64ca-89ad-4fee-8c83-c70e86cc4cb9 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-b8349c53-2931-4166-9c38-83acbd21a526 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXVMiALw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:41:16 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5b5769-5c77-4640-a198-481858f965b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf55135-5998-43b8-aff7-66c6bf458722]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:16 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:16 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb0425510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7'): ({'sdh'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Removing single pathed devices sdh {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b8a0be-add6-44cb-a88e-6ac860de6487]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ce0bbe-03ec-4561-aca3-dabea0c77d52]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Flushing IO for device /dev/sdh {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1219683-1a7e-4a4f-9c95-42de5baa7c19]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f0a9c9-7454-4c5f-a07d-736157353cc6]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] SCSI volumes sdh have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93a3943-c3c1-420a-b12a-f5dd60000cfa]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[05589ae3-05f7-4a5d-a046-23ed67977f54]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7, portal: 172.16.0.220,3260]
Aug 26 11:41:16 user nova-compute[73068]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7, portal: 172.16.0.220,3260] successful.
Aug 26 11:41:16 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:947e2435-253d-489b-9f1a-24dfd22c5cc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf858d4f-e6a7-4a3d-85f7-cddd5a081a63]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] <== disconnect_volume: return (391ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FKneTmIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:41:16 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[07561758-e8f8-4d5c-b131-7b4efbb7e27a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8049407e-67bd-47c4-8427-cf14e11d70b2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:16 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:16 user nova-compute[73068]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b (non-flash)
Aug 26 11:41:16 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9037d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b'): ({'sdi'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Removing single pathed devices sdi {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dc954f-ecb3-48a6-a02d-597d1f32f657]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a1c589-18ce-4660-926e-4c29f9087c23]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Flushing IO for device /dev/sdi {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d35eda-ed8e-41ba-98a3-99168bd75e95]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.065s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7320c0a-35bd-4981-8065-cf6a94caa328]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] SCSI volumes sdi have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed0e8dc-f9ce-43e8-8b31-f75aed71f4db]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[972bf17c-3afe-4df7-9d8b-133dd68d9074]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b, portal: 172.16.0.220,3260]
Aug 26 11:41:16 user nova-compute[73068]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b, portal: 172.16.0.220,3260] successful.
Aug 26 11:41:16 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b24e73d0-63fc-4066-9ebc-d70188fcea5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1342c1c5-1b51-4238-a761-2ee560b763e9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] <== disconnect_volume: return (373ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:41:16 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Deleting instance files /opt/stack/data/nova/instances/23af7614-b27e-4e97-8180-5289cf8d9bcc_del
Aug 26 11:41:16 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Deletion of /opt/stack/data/nova/instances/23af7614-b27e-4e97-8180-5289cf8d9bcc_del complete
Aug 26 11:41:16 user nova-compute[73068]: INFO nova.compute.manager [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Took 3.92 seconds to destroy the instance on the hypervisor.
Aug 26 11:41:16 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:41:16 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-unplugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-deleted-c1f2ea89-5b9c-46ba-a9a9-16e75263b153 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:17 user nova-compute[73068]: INFO nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Neutron deleted interface c1f2ea89-5b9c-46ba-a9a9-16e75263b153; detaching it from the instance and deleting it from the info cache
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.network.neutron [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [{"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "address": "fa:16:3e:1d:d6:e1", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b676f78-69", "ovs_interfaceid": "3b676f78-696f-4ef3-8529-a3892bf0aeb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Detach interface failed, port_id=c1f2ea89-5b9c-46ba-a9a9-16e75263b153, reason: Instance 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:17 user nova-compute[73068]: WARNING nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-10b083eb-5813-4a51-8e7d-9fd1afbdd97b for instance with vm_state active and task_state deleting.
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-deleted-3b676f78-696f-4ef3-8529-a3892bf0aeb1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:17 user nova-compute[73068]: INFO nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Neutron deleted interface 3b676f78-696f-4ef3-8529-a3892bf0aeb1; detaching it from the instance and deleting it from the info cache
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.network.neutron [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [{"id": "0627ade3-5789-4bab-8e59-684ca2e6b871", "address": "fa:16:3e:74:09:4e", "network": {"id": "81cd492b-d44a-49d5-a375-15ca08c663e9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-109242732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0627ade3-57", "ovs_interfaceid": "0627ade3-5789-4bab-8e59-684ca2e6b871", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "address": "fa:16:3e:05:d3:75", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap542f57ca-0e", "ovs_interfaceid": "542f57ca-0e66-4492-a4d5-1fbbd78d5a3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "address": "fa:16:3e:da:c2:07", "network": {"id": "97a5ae4c-4433-4457-b117-0c0c8685a268", "bridge": "br-int", "label": "tempest-device-tagging-net1-1937118807", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39175659a66542958d7d93274ee45cde", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a1c39f9-cc", "ovs_interfaceid": "4a1c39f9-cc7f-4d2a-9e96-745e82aac4b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-38e89f20-324c-42a8-b286-b022ab97645c req-bc96924b-0988-4cb0-9de4-33da7114f024 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Detach interface failed, port_id=3b676f78-696f-4ef3-8529-a3892bf0aeb1, reason: Instance 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:41:17 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:17 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Took 7.76 seconds to deallocate network for instance.
Aug 26 11:41:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-b8349c53-2931-4166-9c38-83acbd21a526 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-b8349c53-2931-4166-9c38-83acbd21a526 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:18 user nova-compute[73068]: WARNING nova.compute.manager [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-b8349c53-2931-4166-9c38-83acbd21a526 for instance with vm_state active and task_state deleting.
Aug 26 11:41:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-unplugged-27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-unplugged-27a00e05-7181-4d39-92ab-121218d84e48 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-plugged-27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] Acquiring lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] No waiting events found dispatching network-vif-plugged-27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:18 user nova-compute[73068]: WARNING nova.compute.manager [req-de33f4ac-99a0-4cf5-b859-bce50d565f67 req-dfa943ef-f89f-4966-9c49-a4fc376a06cc service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received unexpected event network-vif-plugged-27a00e05-7181-4d39-92ab-121218d84e48 for instance with vm_state active and task_state deleting.
Aug 26 11:41:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-bfd0fe28-92d2-4833-8ffd-a4b3501b4953 req-065170f4-1a3c-4766-b9e9-b24ca6220763 service nova] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Received event network-vif-deleted-0627ade3-5789-4bab-8e59-684ca2e6b871 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:20 user nova-compute[73068]: DEBUG nova.compute.manager [req-95f63b81-8951-448b-989c-f8992dfb9f78 req-eed9b86c-5fff-42e5-b2e9-033b14ae2135 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-deleted-27a00e05-7181-4d39-92ab-121218d84e48 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:20 user nova-compute[73068]: INFO nova.compute.manager [req-95f63b81-8951-448b-989c-f8992dfb9f78 req-eed9b86c-5fff-42e5-b2e9-033b14ae2135 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Neutron deleted interface 27a00e05-7181-4d39-92ab-121218d84e48; detaching it from the instance and deleting it from the info cache
Aug 26 11:41:20 user nova-compute[73068]: DEBUG nova.network.neutron [req-95f63b81-8951-448b-989c-f8992dfb9f78 req-eed9b86c-5fff-42e5-b2e9-033b14ae2135 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [{"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "address": "fa:16:3e:e0:63:d9", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c95ec3-db", "ovs_interfaceid": "e9c95ec3-dbcc-4eb5-8787-788c1ea7d118", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:20 user nova-compute[73068]: DEBUG nova.compute.manager [req-95f63b81-8951-448b-989c-f8992dfb9f78 req-eed9b86c-5fff-42e5-b2e9-033b14ae2135 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Detach interface failed, port_id=27a00e05-7181-4d39-92ab-121218d84e48, reason: Instance 23af7614-b27e-4e97-8180-5289cf8d9bcc could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:41:20 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050065.2932665, a86048fe-ddbb-49b3-b2da-8efc895346ba => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:41:20 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] VM Stopped (Lifecycle Event)
Aug 26 11:41:20 user nova-compute[73068]: DEBUG nova.compute.manager [None req-0c15ccd0-801d-4033-b87f-99b106766e5b None None] [instance: a86048fe-ddbb-49b3-b2da-8efc895346ba] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:41:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:20 user nova-compute[73068]: INFO nova.compute.manager [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Took 3.04 seconds to detach 3 volumes for instance.
Aug 26 11:41:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:20 user nova-compute[73068]: DEBUG nova.compute.manager [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:41:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.213s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:41:21 user nova-compute[73068]: INFO nova.compute.claims [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Claim successful on node user
Aug 26 11:41:21 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Deleted allocations for instance 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8
Aug 26 11:41:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-37b2c4ac-b218-40af-9c33-9144dfcac148 tempest-TaggedBootDevicesTest-1872630429 tempest-TaggedBootDevicesTest-1872630429-project-member] Lock "8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.679s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.network.neutron [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:41:21 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.policy [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f4f185d03b044309bab5ec41ecefdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2388755cf904f42b3d230d79ec6872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:41:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:41:21 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Creating image(s)
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.215s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-deleted-e9c95ec3-dbcc-4eb5-8787-788c1ea7d118 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:22 user nova-compute[73068]: INFO nova.compute.manager [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Neutron deleted interface e9c95ec3-dbcc-4eb5-8787-788c1ea7d118; detaching it from the instance and deleting it from the info cache
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.network.neutron [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [{"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "address": "fa:16:3e:e7:d5:47", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b083eb-58", "ovs_interfaceid": "10b083eb-5813-4a51-8e7d-9fd1afbdd97b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Detach interface failed, port_id=e9c95ec3-dbcc-4eb5-8787-788c1ea7d118, reason: Instance 23af7614-b27e-4e97-8180-5289cf8d9bcc could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-deleted-10b083eb-5813-4a51-8e7d-9fd1afbdd97b {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:22 user nova-compute[73068]: INFO nova.compute.manager [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Neutron deleted interface 10b083eb-5813-4a51-8e7d-9fd1afbdd97b; detaching it from the instance and deleting it from the info cache
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.network.neutron [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [{"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "address": "fa:16:3e:49:8c:a2", "network": {"id": "a7856263-1844-4970-b044-e14c0a0625b8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1861848762", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6063758d-5a", "ovs_interfaceid": "6063758d-5a93-4b48-9d31-fad4e01a7e9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Detach interface failed, port_id=10b083eb-5813-4a51-8e7d-9fd1afbdd97b, reason: Instance 23af7614-b27e-4e97-8180-5289cf8d9bcc could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-deleted-6063758d-5a93-4b48-9d31-fad4e01a7e9c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:22 user nova-compute[73068]: INFO nova.compute.manager [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Neutron deleted interface 6063758d-5a93-4b48-9d31-fad4e01a7e9c; detaching it from the instance and deleting it from the info cache
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.network.neutron [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [{"id": "13c74443-704c-42ea-a6c9-318fdb45bf39", "address": "fa:16:3e:ed:f0:f0", "network": {"id": "30547f21-ccab-478e-9b3a-10ed8863f9e5", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1997196736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c74443-70", "ovs_interfaceid": "13c74443-704c-42ea-a6c9-318fdb45bf39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8349c53-2931-4166-9c38-83acbd21a526", "address": "fa:16:3e:c3:00:f3", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8349c53-29", "ovs_interfaceid": "b8349c53-2931-4166-9c38-83acbd21a526", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7d526e58-f0c8-4959-a451-267b715b2eff", "address": "fa:16:3e:7b:f3:a1", "network": {"id": "4911313b-680d-460f-bcd7-a6d3a79e2308", "bridge": "br-int", "label": "tempest-device-tagging-net1-76243311", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b3d06304213c49a58e2896200963e7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d526e58-f0", "ovs_interfaceid": "7d526e58-f0c8-4959-a451-267b715b2eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050067.416545, 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:41:22 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] VM Stopped (Lifecycle Event)
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.231s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-0713a3e6-c5e5-4e0d-90b6-cf71db86fe47 None None] [instance: 8ef0e1c6-b5b9-4119-b29e-3d30bd4d78e8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk 1073741824" returned: 0 in 0.061s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-fe3733c2-d2f9-4429-a9de-b542b1e4f469 req-adeb0e04-912d-48b1-923c-3ac83896a595 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Detach interface failed, port_id=6063758d-5a93-4b48-9d31-fad4e01a7e9c, reason: Instance 23af7614-b27e-4e97-8180-5289cf8d9bcc could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:22 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Took 5.61 seconds to deallocate network for instance.
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.210s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.network.neutron [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Successfully created port: 8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Cannot resize image /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Ensure instance console log exists: /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:23 user nova-compute[73068]: DEBUG nova.network.neutron [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Successfully updated port: 8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:41:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:41:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquired lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:41:23 user nova-compute[73068]: DEBUG nova.network.neutron [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:41:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-513b1ec4-92c2-4bb2-ac5b-fab01fb2f7f9 req-d5590ff2-bc31-4a6d-adfd-feb8d1022def service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-changed-8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-513b1ec4-92c2-4bb2-ac5b-fab01fb2f7f9 req-d5590ff2-bc31-4a6d-adfd-feb8d1022def service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Refreshing instance network info cache due to event network-changed-8d1782f8-3600-4a40-8d7a-c90fa0af9940. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:41:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-513b1ec4-92c2-4bb2-ac5b-fab01fb2f7f9 req-d5590ff2-bc31-4a6d-adfd-feb8d1022def service nova] Acquiring lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:41:23 user nova-compute[73068]: DEBUG nova.network.neutron [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.network.neutron [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updating instance_info_cache with network_info: [{"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Releasing lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Instance network_info: |[{"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-513b1ec4-92c2-4bb2-ac5b-fab01fb2f7f9 req-d5590ff2-bc31-4a6d-adfd-feb8d1022def service nova] Acquired lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.network.neutron [req-513b1ec4-92c2-4bb2-ac5b-fab01fb2f7f9 req-d5590ff2-bc31-4a6d-adfd-feb8d1022def service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Refreshing network info cache for port 8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Start _get_guest_xml network_info=[{"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:41:24 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:41:24 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2100496070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2100496070',id=16,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKbySJmVWh9UQ7qb3tUFqXAG4F4u73SvfWieL2FnPT9HdG8s0mzeP8XQ+eMqOdGsZsgImfuW6s2qjo030oPbO+cr3zcJ8y7QBNnWq0FqFvKKQfT+n/6uIS6SeAzAbYcrQ==',key_name='tempest-keypair-1068818479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2388755cf904f42b3d230d79ec6872d',ramdisk_id='',reservation_id='r-ttxk903y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-614082727',owner_user_name='tempest-TaggedAttachmentsTest-614082727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:41:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4f185d03b044309bab5ec41ecefdf0',uuid=cdb99751-19de-4c5d-a907-c26171588ac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converting VIF {"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=8d1782f8-3600-4a40-8d7a-c90fa0af9940,network=Network(07df5834-2979-480c-b8d1-950c912e6f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d1782f8-36') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.objects.instance [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lazy-loading 'pci_devices' on Instance uuid cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-0626968c-6d01-4adc-a627-511ee9ef7c16 req-8de1a72d-7d01-4b6a-ae8b-ea15501b1862 service nova] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Received event network-vif-deleted-13c74443-704c-42ea-a6c9-318fdb45bf39 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:41:24 user nova-compute[73068]:   <uuid>cdb99751-19de-4c5d-a907-c26171588ac8</uuid>
Aug 26 11:41:24 user nova-compute[73068]:   <name>instance-00000010</name>
Aug 26 11:41:24 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:41:24 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:41:24 user nova-compute[73068]:   <metadata>
Aug 26 11:41:24 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:41:24 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:41:24 user nova-compute[73068]:       <nova:name>tempest-device-tagging-server-2100496070</nova:name>
Aug 26 11:41:24 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:41:24</nova:creationTime>
Aug 26 11:41:24 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:41:24 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:41:24 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:41:24 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:41:24 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:41:24 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:41:24 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:41:24 user nova-compute[73068]:       <nova:owner>
Aug 26 11:41:24 user nova-compute[73068]:         <nova:user uuid="3f4f185d03b044309bab5ec41ecefdf0">tempest-TaggedAttachmentsTest-614082727-project-member</nova:user>
Aug 26 11:41:24 user nova-compute[73068]:         <nova:project uuid="e2388755cf904f42b3d230d79ec6872d">tempest-TaggedAttachmentsTest-614082727</nova:project>
Aug 26 11:41:24 user nova-compute[73068]:       </nova:owner>
Aug 26 11:41:24 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:41:24 user nova-compute[73068]:       <nova:ports>
Aug 26 11:41:24 user nova-compute[73068]:         <nova:port uuid="8d1782f8-3600-4a40-8d7a-c90fa0af9940">
Aug 26 11:41:24 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 11:41:24 user nova-compute[73068]:         </nova:port>
Aug 26 11:41:24 user nova-compute[73068]:       </nova:ports>
Aug 26 11:41:24 user nova-compute[73068]:     </nova:instance>
Aug 26 11:41:24 user nova-compute[73068]:   </metadata>
Aug 26 11:41:24 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:41:24 user nova-compute[73068]:     <system>
Aug 26 11:41:24 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:41:24 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:41:24 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:41:24 user nova-compute[73068]:       <entry name="serial">cdb99751-19de-4c5d-a907-c26171588ac8</entry>
Aug 26 11:41:24 user nova-compute[73068]:       <entry name="uuid">cdb99751-19de-4c5d-a907-c26171588ac8</entry>
Aug 26 11:41:24 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:41:24 user nova-compute[73068]:     </system>
Aug 26 11:41:24 user nova-compute[73068]:   </sysinfo>
Aug 26 11:41:24 user nova-compute[73068]:   <os>
Aug 26 11:41:24 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:41:24 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:41:24 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:41:24 user nova-compute[73068]:   </os>
Aug 26 11:41:24 user nova-compute[73068]:   <features>
Aug 26 11:41:24 user nova-compute[73068]:     <acpi/>
Aug 26 11:41:24 user nova-compute[73068]:     <apic/>
Aug 26 11:41:24 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:41:24 user nova-compute[73068]:   </features>
Aug 26 11:41:24 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:41:24 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:41:24 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:41:24 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:41:24 user nova-compute[73068]:   </clock>
Aug 26 11:41:24 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:41:24 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:41:24 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:41:24 user nova-compute[73068]:   </cpu>
Aug 26 11:41:24 user nova-compute[73068]:   <devices>
Aug 26 11:41:24 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:41:24 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:41:24 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk"/>
Aug 26 11:41:24 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:41:24 user nova-compute[73068]:     </disk>
Aug 26 11:41:24 user nova-compute[73068]:     <disk type="file" device="cdrom">
Aug 26 11:41:24 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 11:41:24 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk.config"/>
Aug 26 11:41:24 user nova-compute[73068]:       <target dev="hda" bus="ide"/>
Aug 26 11:41:24 user nova-compute[73068]:     </disk>
Aug 26 11:41:24 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:41:24 user nova-compute[73068]:       <mac address="fa:16:3e:b1:37:cc"/>
Aug 26 11:41:24 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:41:24 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:41:24 user nova-compute[73068]:       <target dev="tap8d1782f8-36"/>
Aug 26 11:41:24 user nova-compute[73068]:     </interface>
Aug 26 11:41:24 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:41:24 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/console.log" append="off"/>
Aug 26 11:41:24 user nova-compute[73068]:     </serial>
Aug 26 11:41:24 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:41:24 user nova-compute[73068]:     <video>
Aug 26 11:41:24 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:41:24 user nova-compute[73068]:     </video>
Aug 26 11:41:24 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:41:24 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:41:24 user nova-compute[73068]:     </rng>
Aug 26 11:41:24 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:41:24 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:41:24 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:41:24 user nova-compute[73068]:     </memballoon>
Aug 26 11:41:24 user nova-compute[73068]:   </devices>
Aug 26 11:41:24 user nova-compute[73068]: </domain>
Aug 26 11:41:24 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2100496070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2100496070',id=16,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKbySJmVWh9UQ7qb3tUFqXAG4F4u73SvfWieL2FnPT9HdG8s0mzeP8XQ+eMqOdGsZsgImfuW6s2qjo030oPbO+cr3zcJ8y7QBNnWq0FqFvKKQfT+n/6uIS6SeAzAbYcrQ==',key_name='tempest-keypair-1068818479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2388755cf904f42b3d230d79ec6872d',ramdisk_id='',reservation_id='r-ttxk903y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-614082727',owner_user_name='tempest-TaggedAttachmentsTest-614082727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:41:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4f185d03b044309bab5ec41ecefdf0',uuid=cdb99751-19de-4c5d-a907-c26171588ac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converting VIF {"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=8d1782f8-3600-4a40-8d7a-c90fa0af9940,network=Network(07df5834-2979-480c-b8d1-950c912e6f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d1782f8-36') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG os_vif [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=8d1782f8-3600-4a40-8d7a-c90fa0af9940,network=Network(07df5834-2979-480c-b8d1-950c912e6f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d1782f8-36') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d1782f8-36, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d1782f8-36, col_values=(('external_ids', {'iface-id': '8d1782f8-3600-4a40-8d7a-c90fa0af9940', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:37:cc', 'vm-uuid': 'cdb99751-19de-4c5d-a907-c26171588ac8'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:24 user nova-compute[73068]: INFO os_vif [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=8d1782f8-3600-4a40-8d7a-c90fa0af9940,network=Network(07df5834-2979-480c-b8d1-950c912e6f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d1782f8-36')
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] No BDM found with device name hda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] No VIF found with MAC fa:16:3e:b1:37:cc, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:41:24 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Using config drive
Aug 26 11:41:24 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Creating config drive at /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk.config
Aug 26 11:41:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp629po19f {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp629po19f" returned: 0 in 0.068s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG nova.network.neutron [req-513b1ec4-92c2-4bb2-ac5b-fab01fb2f7f9 req-d5590ff2-bc31-4a6d-adfd-feb8d1022def service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updated VIF entry in instance network info cache for port 8d1782f8-3600-4a40-8d7a-c90fa0af9940. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG nova.network.neutron [req-513b1ec4-92c2-4bb2-ac5b-fab01fb2f7f9 req-d5590ff2-bc31-4a6d-adfd-feb8d1022def service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updating instance_info_cache with network_info: [{"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-513b1ec4-92c2-4bb2-ac5b-fab01fb2f7f9 req-d5590ff2-bc31-4a6d-adfd-feb8d1022def service nova] Releasing lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vblGekRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:41:25 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:25 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:25 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a147d1a-14f9-487e-8805-9b00ceb8904f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:41:25 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a6e6bc-9cb2-4c43-aa37-da4b25c54065]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528] added
Aug 26 11:41:25 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4aeb33-3600-4ecf-9a9b-e9e262893645]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[481c9f76-160b-4115-b9ee-8069bb70acda]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vblGekRc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vblGekRc" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4815563-f6f0-4d45-a3fe-8e5abf672547]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vblGekRc'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7832ca17-8a54-45d9-898c-1ecc6b32ee86]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:25 user nova-compute[73068]: INFO nova.compute.manager [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Took 2.87 seconds to detach 3 volumes for instance.
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7e6993-35fc-4ffb-94e8-2e20f6bb08c9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb0573e-ae7d-44a5-8cb5-96ff307c8798]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528, portal: 172.16.0.220,3260]
Aug 26 11:41:25 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528, portal: 172.16.0.220,3260] successful.
Aug 26 11:41:25 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8624e0e6-519f-468f-b44c-b310dd7efb64]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[72918a56-4186-4eb6-bccb-0f0353c7adf0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:25 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4481ae-079f-40af-b65c-9aa3568fdb51]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vblGekRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:41:25 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:26 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Deleted allocations for instance 23af7614-b27e-4e97-8180-5289cf8d9bcc
Aug 26 11:41:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b939b5a8-b502-47ff-988b-7270419ab07c tempest-TaggedBootDevicesTest_v242-760066924 tempest-TaggedBootDevicesTest_v242-760066924-project-member] Lock "23af7614-b27e-4e97-8180-5289cf8d9bcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.111s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-e3f5df2e-454c-4b88-88d4-cb8e895817e6 req-695765a5-fd7a-45a7-858d-1bc0cff59f3f service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-vif-plugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e3f5df2e-454c-4b88-88d4-cb8e895817e6 req-695765a5-fd7a-45a7-858d-1bc0cff59f3f service nova] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e3f5df2e-454c-4b88-88d4-cb8e895817e6 req-695765a5-fd7a-45a7-858d-1bc0cff59f3f service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e3f5df2e-454c-4b88-88d4-cb8e895817e6 req-695765a5-fd7a-45a7-858d-1bc0cff59f3f service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-e3f5df2e-454c-4b88-88d4-cb8e895817e6 req-695765a5-fd7a-45a7-858d-1bc0cff59f3f service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] No waiting events found dispatching network-vif-plugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:26 user nova-compute[73068]: WARNING nova.compute.manager [req-e3f5df2e-454c-4b88-88d4-cb8e895817e6 req-695765a5-fd7a-45a7-858d-1bc0cff59f3f service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received unexpected event network-vif-plugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 for instance with vm_state building and task_state spawning.
Aug 26 11:41:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23936326438643932', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936326438643932', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lazy-loading 'flavor' on Instance uuid 2881e7a6-0099-4b87-819b-c36dd3db99c8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:26 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:41:26 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:41:26 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:41:26 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:41:26 user nova-compute[73068]:   <serial>377fc6be-01f4-4523-8775-06c396ae0528</serial>
Aug 26 11:41:26 user nova-compute[73068]: </disk>
Aug 26 11:41:26 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:41:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:41:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:41:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] No VIF found with MAC fa:16:3e:89:c9:f1, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:41:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a090281c-d9ab-4458-8986-924cdcf45169 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.102s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050088.538577, cdb99751-19de-4c5d-a907-c26171588ac8 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:41:28 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] VM Resumed (Lifecycle Event)
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:41:28 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Instance spawned successfully.
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:41:28 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050088.539744, cdb99751-19de-4c5d-a907-c26171588ac8 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:41:28 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] VM Started (Lifecycle Event)
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-b0f3270a-46c4-4e2f-a97b-3201f4402b5d req-8e72569b-c19a-4fca-a6cd-232f37edfc3e service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-vif-plugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b0f3270a-46c4-4e2f-a97b-3201f4402b5d req-8e72569b-c19a-4fca-a6cd-232f37edfc3e service nova] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b0f3270a-46c4-4e2f-a97b-3201f4402b5d req-8e72569b-c19a-4fca-a6cd-232f37edfc3e service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b0f3270a-46c4-4e2f-a97b-3201f4402b5d req-8e72569b-c19a-4fca-a6cd-232f37edfc3e service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-b0f3270a-46c4-4e2f-a97b-3201f4402b5d req-8e72569b-c19a-4fca-a6cd-232f37edfc3e service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] No waiting events found dispatching network-vif-plugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:28 user nova-compute[73068]: WARNING nova.compute.manager [req-b0f3270a-46c4-4e2f-a97b-3201f4402b5d req-8e72569b-c19a-4fca-a6cd-232f37edfc3e service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received unexpected event network-vif-plugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 for instance with vm_state building and task_state spawning.
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:41:28 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:41:28 user nova-compute[73068]: INFO nova.compute.manager [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Took 6.72 seconds to spawn the instance on the hypervisor.
Aug 26 11:41:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:41:28 user nova-compute[73068]: INFO nova.compute.manager [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Took 7.96 seconds to build instance.
Aug 26 11:41:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c13807cd-de75-4657-83df-8dd07e092618 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.138s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:30 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050075.1847017, 23af7614-b27e-4e97-8180-5289cf8d9bcc => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:41:30 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] VM Stopped (Lifecycle Event)
Aug 26 11:41:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-9427cde8-dee1-4d7c-bdf9-d6ae14b5c4df None None] [instance: 23af7614-b27e-4e97-8180-5289cf8d9bcc] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:41:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:32 user nova-compute[73068]: INFO nova.compute.manager [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Terminating instance
Aug 26 11:41:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-edf16bfa-2b61-46d4-87ba-cb5add45c2a4 req-644cd641-81d7-4246-b3d1-c8a7d97b70f5 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-vif-unplugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-edf16bfa-2b61-46d4-87ba-cb5add45c2a4 req-644cd641-81d7-4246-b3d1-c8a7d97b70f5 service nova] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-edf16bfa-2b61-46d4-87ba-cb5add45c2a4 req-644cd641-81d7-4246-b3d1-c8a7d97b70f5 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-edf16bfa-2b61-46d4-87ba-cb5add45c2a4 req-644cd641-81d7-4246-b3d1-c8a7d97b70f5 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-edf16bfa-2b61-46d4-87ba-cb5add45c2a4 req-644cd641-81d7-4246-b3d1-c8a7d97b70f5 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] No waiting events found dispatching network-vif-unplugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-edf16bfa-2b61-46d4-87ba-cb5add45c2a4 req-644cd641-81d7-4246-b3d1-c8a7d97b70f5 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-vif-unplugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:41:32 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Instance destroyed successfully.
Aug 26 11:41:32 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lazy-loading 'resources' on Instance uuid 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-772664691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-800782579',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/ZA4n0oqdwxudhPdUfBqQgXyjpwc/T+oPc5U+vqaCyvzEcT70JQD8EejyFZzqJOf+nGQXLZHuQHaE86x94DM7IeG2QP7b5azKYS86x18eGLwCVUieLMNu0xFns9T2eA==',key_name='tempest-keypair-1654929932',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:40:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6d54004525be4f06a7f9c1dc86ec3248',ramdisk_id='',reservation_id='r-5ar52vv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1026667147',owner_user_name='tempest-ServerActionsV293TestJSON-1026667147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bd5b5460f15416c8b7851b85fe3da30',uuid=8a96b57f-dd74-45b8-aa23-a6187dc4bb93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converting VIF {"id": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "address": "fa:16:3e:f6:aa:bd", "network": {"id": "8eacb0e5-8eb0-4b20-8e1b-63460ac38a44", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1834704397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6d54004525be4f06a7f9c1dc86ec3248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2000fb73-9c", "ovs_interfaceid": "2000fb73-9c36-4d66-802c-4e5b0aa88226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG os_vif [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2000fb73-9c, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:32 user nova-compute[73068]: INFO os_vif [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:aa:bd,bridge_name='br-int',has_traffic_filtering=True,id=2000fb73-9c36-4d66-802c-4e5b0aa88226,network=Network(8eacb0e5-8eb0-4b20-8e1b-63460ac38a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2000fb73-9c')
Aug 26 11:41:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JFyOtqMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:41:32 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3f4421-d36c-498d-87ab-488618429cd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79bafec-4646-4a6f-b799-31bbbfbdd9fc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:33 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:33 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:33 user nova-compute[73068]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)
Aug 26 11:41:33 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:33 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:33 user nova-compute[73068]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 (non-flash)
Aug 26 11:41:33 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:33 user nova-compute[73068]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)
Aug 26 11:41:33 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:33 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb059fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2cd11d-6c7c-4be3-98ee-83d47e50d41f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[651d75fe-727e-4812-8b30-c3866a189cb6]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d516ab33-b1ba-4218-b0ce-7e0ad150ce7b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[376e94b1-8386-45d1-b221-f666d219e443]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e37614ac', '/dev/disk/by-id/scsi-1SCST_BIOe37614ac-f4a2671a32b81b16', '/dev/disk/by-id/scsi-26634613236373161') {{(pid=83861) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 11:41:33 user nova-compute[73068]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e37614ac
Aug 26 11:41:33 user nova-compute[73068]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe37614ac-f4a2671a32b81b16
Aug 26 11:41:33 user nova-compute[73068]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26634613236373161
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f21ec0-1940-4dc9-ad5c-27c70179c363]: (4, None) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2493c104-0691-453a-be52-e066b706b5e0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1706cab3-b923-49a4-beaa-9027122f88fc]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260]
Aug 26 11:41:33 user nova-compute[73068]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517, portal: 172.16.0.220,3260] successful.
Aug 26 11:41:33 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6769dd3-49e3-48fc-8c4f-907a17b55517 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[699ef24d-691d-4f17-9bcc-f2c80dcd2ce7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] <== disconnect_volume: return (404ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:41:33 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Deleting instance files /opt/stack/data/nova/instances/8a96b57f-dd74-45b8-aa23-a6187dc4bb93_del
Aug 26 11:41:33 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Deletion of /opt/stack/data/nova/instances/8a96b57f-dd74-45b8-aa23-a6187dc4bb93_del complete
Aug 26 11:41:33 user nova-compute[73068]: INFO nova.compute.manager [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 26 11:41:33 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:41:33 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:41:34 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:41:34 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Took 1.03 seconds to deallocate network for instance.
Aug 26 11:41:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-e526a44c-85f1-4763-9262-28dbaf19c1cb req-b12b4e7a-d2f2-47b5-a308-e16e0d4111d4 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e526a44c-85f1-4763-9262-28dbaf19c1cb req-b12b4e7a-d2f2-47b5-a308-e16e0d4111d4 service nova] Acquiring lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e526a44c-85f1-4763-9262-28dbaf19c1cb req-b12b4e7a-d2f2-47b5-a308-e16e0d4111d4 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e526a44c-85f1-4763-9262-28dbaf19c1cb req-b12b4e7a-d2f2-47b5-a308-e16e0d4111d4 service nova] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-e526a44c-85f1-4763-9262-28dbaf19c1cb req-b12b4e7a-d2f2-47b5-a308-e16e0d4111d4 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] No waiting events found dispatching network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:41:34 user nova-compute[73068]: WARNING nova.compute.manager [req-e526a44c-85f1-4763-9262-28dbaf19c1cb req-b12b4e7a-d2f2-47b5-a308-e16e0d4111d4 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received unexpected event network-vif-plugged-2000fb73-9c36-4d66-802c-4e5b0aa88226 for instance with vm_state active and task_state deleting.
Aug 26 11:41:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-e526a44c-85f1-4763-9262-28dbaf19c1cb req-b12b4e7a-d2f2-47b5-a308-e16e0d4111d4 service nova] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Received event network-vif-deleted-2000fb73-9c36-4d66-802c-4e5b0aa88226 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:41:35 user nova-compute[73068]: INFO nova.compute.manager [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Took 0.90 seconds to detach 1 volumes for instance.
Aug 26 11:41:35 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Deleting volume: d6769dd3-49e3-48fc-8c4f-907a17b55517 {{(pid=73068) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 11:41:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:35 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:41:35 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:41:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:35 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Deleted allocations for instance 8a96b57f-dd74-45b8-aa23-a6187dc4bb93
Aug 26 11:41:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b9410779-98fc-464f-8c19-124b5c44efc1 tempest-ServerActionsV293TestJSON-1026667147 tempest-ServerActionsV293TestJSON-1026667147-project-member] Lock "8a96b57f-dd74-45b8-aa23-a6187dc4bb93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.976s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:47 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050092.8835359, 8a96b57f-dd74-45b8-aa23-a6187dc4bb93 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:41:47 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] VM Stopped (Lifecycle Event)
Aug 26 11:41:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-66898ca0-ff31-4b4d-b5c6-bbe14086238d None None] [instance: 8a96b57f-dd74-45b8-aa23-a6187dc4bb93] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:41:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "937978de-8e83-42e7-b906-ccc226924f1f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:41:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:41:55 user nova-compute[73068]: INFO nova.compute.manager [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Detaching volume 164b8e0c-a789-4590-8b65-04a1c7878965
Aug 26 11:41:55 user nova-compute[73068]: INFO nova.virt.block_device [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Attempting to driver detach volume 164b8e0c-a789-4590-8b65-04a1c7878965 from mountpoint /dev/vdb
Aug 26 11:41:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Attempting to detach device vdb from instance 937978de-8e83-42e7-b906-ccc226924f1f from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:41:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:41:55 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:41:55 user nova-compute[73068]:   <source dev="/dev/sdf"/>
Aug 26 11:41:55 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:41:55 user nova-compute[73068]:   <serial>164b8e0c-a789-4590-8b65-04a1c7878965</serial>
Aug 26 11:41:55 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:41:55 user nova-compute[73068]: </disk>
Aug 26 11:41:55 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:41:55 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully detached device vdb from instance 937978de-8e83-42e7-b906-ccc226924f1f from the persistent domain config.
Aug 26 11:41:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 937978de-8e83-42e7-b906-ccc226924f1f from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:41:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:41:55 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:41:55 user nova-compute[73068]:   <source dev="/dev/sdf"/>
Aug 26 11:41:55 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:41:55 user nova-compute[73068]:   <serial>164b8e0c-a789-4590-8b65-04a1c7878965</serial>
Aug 26 11:41:55 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:41:55 user nova-compute[73068]: </disk>
Aug 26 11:41:55 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050116.3678606, 937978de-8e83-42e7-b906-ccc226924f1f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 937978de-8e83-42e7-b906-ccc226924f1f {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:41:56 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully detached device vdb from instance 937978de-8e83-42e7-b906-ccc226924f1f from the live domain config.
Aug 26 11:41:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MzipRWCB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:41:56 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bb2a23-88ff-485b-b7c0-e080e204b396]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[540ffd05-81ee-4270-a5d0-8fa8cf4db36d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:56 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:56 user nova-compute[73068]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)
Aug 26 11:41:56 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:41:56 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:41:56 user nova-compute[73068]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)
Aug 26 11:41:56 user nova-compute[73068]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 (non-flash)
Aug 26 11:41:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9036b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965'): ({'sdf'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Removing single pathed devices sdf {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8047df3-319a-4a9f-9845-b0916b922d0a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04e2fe2-1664-448d-8e17-065a2725c94f]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Flushing IO for device /dev/sdf {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac75d19b-78cd-4a88-a0b8-1edf869ad953]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[80459bd9-ecb4-4be2-bae8-eb1e3eced64e]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] SCSI volumes sdf have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91c3ec5-65d6-414d-acbf-274873b4983b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0c2a28-be40-4269-9e6f-28db0b9a3fd4]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965, portal: 172.16.0.220,3260]
Aug 26 11:41:56 user nova-compute[73068]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965, portal: 172.16.0.220,3260] successful.
Aug 26 11:41:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:164b8e0c-a789-4590-8b65-04a1c7878965 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4731acc-63ed-4731-86e3-71d632c40749]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] <== disconnect_volume: return (335ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:41:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:41:57 user nova-compute[73068]: DEBUG nova.objects.instance [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'flavor' on Instance uuid 937978de-8e83-42e7-b906-ccc226924f1f {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:41:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0e7c4cd3-852c-4463-b2f5-fdcd4ddeb023 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.205s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:41:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:41:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:03 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:03 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:03 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:42:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:42:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:42:03 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:42:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Updating instance_info_cache with network_info: [{"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-792b5efb-63fa-4e87-b114-61de6180b2c6" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:42:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.rescue --force-share --output=json" returned: 0 in 0.265s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:42:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:42:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:08 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:42:08 user nova-compute[73068]: INFO nova.compute.claims [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Claim successful on node user
Aug 26 11:42:08 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:42:08 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:42:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7499MB free_disk=25.560344696044922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:42:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.834s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.364s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:42:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 937978de-8e83-42e7-b906-ccc226924f1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance fba812b3-7791-463f-9c86-a51ae7a7457d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 792b5efb-63fa-4e87-b114-61de6180b2c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2881e7a6-0099-4b87-819b-c36dd3db99c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance deb7b9f5-d717-4d73-997a-0914c56f546c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance cdb99751-19de-4c5d-a907-c26171588ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a39507fb-9897-4e5d-8217-390785208d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.policy [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d8a761bf9474faba69a5ec80149f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96de3b4133bc4201880aba9e21a28a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:42:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Creating image(s)
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "/opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "/opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "/opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk 1073741824" returned: 0 in 0.056s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:10 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:42:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:10 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Successfully created port: c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:42:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:10 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Cannot resize image /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:42:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:42:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Ensure instance console log exists: /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:42:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Successfully updated port: c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquired lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-32c87f00-e925-4cac-9e52-b180ff93e651 req-8007fa08-6f65-48dd-8a07-c9ba63591f8f service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-changed-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-32c87f00-e925-4cac-9e52-b180ff93e651 req-8007fa08-6f65-48dd-8a07-c9ba63591f8f service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Refreshing instance network info cache due to event network-changed-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-32c87f00-e925-4cac-9e52-b180ff93e651 req-8007fa08-6f65-48dd-8a07-c9ba63591f8f service nova] Acquiring lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updating instance_info_cache with network_info: [{"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Releasing lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Instance network_info: |[{"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-32c87f00-e925-4cac-9e52-b180ff93e651 req-8007fa08-6f65-48dd-8a07-c9ba63591f8f service nova] Acquired lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-32c87f00-e925-4cac-9e52-b180ff93e651 req-8007fa08-6f65-48dd-8a07-c9ba63591f8f service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Refreshing network info cache for port c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Start _get_guest_xml network_info=[{"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:42:11 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:42:11 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1102777405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1102777405',id=17,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9Gj2bnIjg7444NWeZckpmwe+Wf6W6d1gltaDp/C9XW68jMmoSS2jQz+RS/tFm7h8fYZMoB2wf4HRsIVu8CUTRpQgs2yU6z7rZaUWorfQO4WfxJNnTHhaZ2pwqgBZtyUw==',key_name='tempest-keypair-1963762537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-uuvfbky6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:42:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=a39507fb-9897-4e5d-8217-390785208d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.objects.instance [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'pci_devices' on Instance uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:42:11 user nova-compute[73068]:   <uuid>a39507fb-9897-4e5d-8217-390785208d52</uuid>
Aug 26 11:42:11 user nova-compute[73068]:   <name>instance-00000011</name>
Aug 26 11:42:11 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:42:11 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:42:11 user nova-compute[73068]:   <metadata>
Aug 26 11:42:11 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:42:11 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:42:11 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1102777405</nova:name>
Aug 26 11:42:11 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:42:11</nova:creationTime>
Aug 26 11:42:11 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:42:11 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:42:11 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:42:11 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:42:11 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:42:11 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:42:11 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:42:11 user nova-compute[73068]:       <nova:owner>
Aug 26 11:42:11 user nova-compute[73068]:         <nova:user uuid="5d8a761bf9474faba69a5ec80149f352">tempest-AttachVolumeShelveTestJSON-273124191-project-member</nova:user>
Aug 26 11:42:11 user nova-compute[73068]:         <nova:project uuid="96de3b4133bc4201880aba9e21a28a6e">tempest-AttachVolumeShelveTestJSON-273124191</nova:project>
Aug 26 11:42:11 user nova-compute[73068]:       </nova:owner>
Aug 26 11:42:11 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:42:11 user nova-compute[73068]:       <nova:ports>
Aug 26 11:42:11 user nova-compute[73068]:         <nova:port uuid="c0a2f992-3673-45ea-89b4-5f3fa6b65ef6">
Aug 26 11:42:11 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 11:42:11 user nova-compute[73068]:         </nova:port>
Aug 26 11:42:11 user nova-compute[73068]:       </nova:ports>
Aug 26 11:42:11 user nova-compute[73068]:     </nova:instance>
Aug 26 11:42:11 user nova-compute[73068]:   </metadata>
Aug 26 11:42:11 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:42:11 user nova-compute[73068]:     <system>
Aug 26 11:42:11 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:42:11 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:42:11 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:42:11 user nova-compute[73068]:       <entry name="serial">a39507fb-9897-4e5d-8217-390785208d52</entry>
Aug 26 11:42:11 user nova-compute[73068]:       <entry name="uuid">a39507fb-9897-4e5d-8217-390785208d52</entry>
Aug 26 11:42:11 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:42:11 user nova-compute[73068]:     </system>
Aug 26 11:42:11 user nova-compute[73068]:   </sysinfo>
Aug 26 11:42:11 user nova-compute[73068]:   <os>
Aug 26 11:42:11 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:42:11 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:42:11 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:42:11 user nova-compute[73068]:   </os>
Aug 26 11:42:11 user nova-compute[73068]:   <features>
Aug 26 11:42:11 user nova-compute[73068]:     <acpi/>
Aug 26 11:42:11 user nova-compute[73068]:     <apic/>
Aug 26 11:42:11 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:42:11 user nova-compute[73068]:   </features>
Aug 26 11:42:11 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:42:11 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:42:11 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:42:11 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:42:11 user nova-compute[73068]:   </clock>
Aug 26 11:42:11 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:42:11 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:42:11 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:42:11 user nova-compute[73068]:   </cpu>
Aug 26 11:42:11 user nova-compute[73068]:   <devices>
Aug 26 11:42:11 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:42:11 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:42:11 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk"/>
Aug 26 11:42:11 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:42:11 user nova-compute[73068]:     </disk>
Aug 26 11:42:11 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:42:11 user nova-compute[73068]:       <mac address="fa:16:3e:14:98:e8"/>
Aug 26 11:42:11 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:42:11 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:42:11 user nova-compute[73068]:       <target dev="tapc0a2f992-36"/>
Aug 26 11:42:11 user nova-compute[73068]:     </interface>
Aug 26 11:42:11 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:42:11 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/console.log" append="off"/>
Aug 26 11:42:11 user nova-compute[73068]:     </serial>
Aug 26 11:42:11 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:42:11 user nova-compute[73068]:     <video>
Aug 26 11:42:11 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:42:11 user nova-compute[73068]:     </video>
Aug 26 11:42:11 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:42:11 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:42:11 user nova-compute[73068]:     </rng>
Aug 26 11:42:11 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:42:11 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:42:11 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:42:11 user nova-compute[73068]:     </memballoon>
Aug 26 11:42:11 user nova-compute[73068]:   </devices>
Aug 26 11:42:11 user nova-compute[73068]: </domain>
Aug 26 11:42:11 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1102777405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1102777405',id=17,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9Gj2bnIjg7444NWeZckpmwe+Wf6W6d1gltaDp/C9XW68jMmoSS2jQz+RS/tFm7h8fYZMoB2wf4HRsIVu8CUTRpQgs2yU6z7rZaUWorfQO4WfxJNnTHhaZ2pwqgBZtyUw==',key_name='tempest-keypair-1963762537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-uuvfbky6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:42:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=a39507fb-9897-4e5d-8217-390785208d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG os_vif [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0a2f992-36, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0a2f992-36, col_values=(('external_ids', {'iface-id': 'c0a2f992-3673-45ea-89b4-5f3fa6b65ef6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:98:e8', 'vm-uuid': 'a39507fb-9897-4e5d-8217-390785208d52'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:11 user nova-compute[73068]: INFO os_vif [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36')
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:42:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] No VIF found with MAC fa:16:3e:14:98:e8, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:42:12 user nova-compute[73068]: DEBUG nova.network.neutron [req-32c87f00-e925-4cac-9e52-b180ff93e651 req-8007fa08-6f65-48dd-8a07-c9ba63591f8f service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updated VIF entry in instance network info cache for port c0a2f992-3673-45ea-89b4-5f3fa6b65ef6. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:42:12 user nova-compute[73068]: DEBUG nova.network.neutron [req-32c87f00-e925-4cac-9e52-b180ff93e651 req-8007fa08-6f65-48dd-8a07-c9ba63591f8f service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updating instance_info_cache with network_info: [{"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-32c87f00-e925-4cac-9e52-b180ff93e651 req-8007fa08-6f65-48dd-8a07-c9ba63591f8f service nova] Releasing lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:42:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-e8637bfd-57ed-449b-8901-889ccb58bd07 req-eb26af9a-942a-42e2-9fde-f42244c56c6a service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e8637bfd-57ed-449b-8901-889ccb58bd07 req-eb26af9a-942a-42e2-9fde-f42244c56c6a service nova] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e8637bfd-57ed-449b-8901-889ccb58bd07 req-eb26af9a-942a-42e2-9fde-f42244c56c6a service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e8637bfd-57ed-449b-8901-889ccb58bd07 req-eb26af9a-942a-42e2-9fde-f42244c56c6a service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-e8637bfd-57ed-449b-8901-889ccb58bd07 req-eb26af9a-942a-42e2-9fde-f42244c56c6a service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] No waiting events found dispatching network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:42:13 user nova-compute[73068]: WARNING nova.compute.manager [req-e8637bfd-57ed-449b-8901-889ccb58bd07 req-eb26af9a-942a-42e2-9fde-f42244c56c6a service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received unexpected event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 for instance with vm_state building and task_state spawning.
Aug 26 11:42:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050135.6579072, a39507fb-9897-4e5d-8217-390785208d52 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:42:15 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] VM Resumed (Lifecycle Event)
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:42:15 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] Instance spawned successfully.
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:15 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050135.6593719, a39507fb-9897-4e5d-8217-390785208d52 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:42:15 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] VM Started (Lifecycle Event)
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:42:15 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:42:15 user nova-compute[73068]: INFO nova.compute.manager [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:42:15 user nova-compute[73068]: INFO nova.compute.manager [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Took 7.62 seconds to build instance.
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-10882acf-18f1-4fe1-bcae-a4000a0b23b9 req-3340f47c-1670-4850-8993-d1a18ebcdc29 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-10882acf-18f1-4fe1-bcae-a4000a0b23b9 req-3340f47c-1670-4850-8993-d1a18ebcdc29 service nova] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-10882acf-18f1-4fe1-bcae-a4000a0b23b9 req-3340f47c-1670-4850-8993-d1a18ebcdc29 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-10882acf-18f1-4fe1-bcae-a4000a0b23b9 req-3340f47c-1670-4850-8993-d1a18ebcdc29 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-10882acf-18f1-4fe1-bcae-a4000a0b23b9 req-3340f47c-1670-4850-8993-d1a18ebcdc29 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] No waiting events found dispatching network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:42:15 user nova-compute[73068]: WARNING nova.compute.manager [req-10882acf-18f1-4fe1-bcae-a4000a0b23b9 req-3340f47c-1670-4850-8993-d1a18ebcdc29 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received unexpected event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 for instance with vm_state active and task_state None.
Aug 26 11:42:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2b186fae-aa41-4cb9-9fbf-53cc5c3bb519 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.753s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:17 user nova-compute[73068]: INFO nova.compute.manager [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Detaching volume 377fc6be-01f4-4523-8775-06c396ae0528
Aug 26 11:42:17 user nova-compute[73068]: INFO nova.virt.block_device [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Attempting to driver detach volume 377fc6be-01f4-4523-8775-06c396ae0528 from mountpoint /dev/vdb
Aug 26 11:42:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Attempting to detach device vdb from instance 2881e7a6-0099-4b87-819b-c36dd3db99c8 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:42:17 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:42:17 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:42:17 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:42:17 user nova-compute[73068]:   <serial>377fc6be-01f4-4523-8775-06c396ae0528</serial>
Aug 26 11:42:17 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:42:17 user nova-compute[73068]: </disk>
Aug 26 11:42:17 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:42:17 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Successfully detached device vdb from instance 2881e7a6-0099-4b87-819b-c36dd3db99c8 from the persistent domain config.
Aug 26 11:42:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2881e7a6-0099-4b87-819b-c36dd3db99c8 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:42:17 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:42:17 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:42:17 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:42:17 user nova-compute[73068]:   <serial>377fc6be-01f4-4523-8775-06c396ae0528</serial>
Aug 26 11:42:17 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:42:17 user nova-compute[73068]: </disk>
Aug 26 11:42:17 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050137.799235, 2881e7a6-0099-4b87-819b-c36dd3db99c8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2881e7a6-0099-4b87-819b-c36dd3db99c8 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:42:17 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Successfully detached device vdb from instance 2881e7a6-0099-4b87-819b-c36dd3db99c8 from the live domain config.
Aug 26 11:42:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vblGekRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:42:17 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:42:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89d69ef-9c65-4068-8742-1a4f6bca3b73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ed0118-e550-4f8e-9178-397672988dbf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:42:17 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:42:17 user nova-compute[73068]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)
Aug 26 11:42:17 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:42:17 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:42:17 user nova-compute[73068]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 (non-flash)
Aug 26 11:42:17 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd90368790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[33053f90-5e9d-4a48-9217-a4a6ee3229d0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ce2803-27cd-4785-a42b-99db72180133]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39b8122-8400-45cf-9b3a-5200b94bb12b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:42:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdd996c-448a-4947-b162-cfbd02c83f56]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea96e332-aa79-4def-89b8-44b65cbedfc9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c932416-9345-443d-95fa-84cbc4f633cd]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528, portal: 172.16.0.220,3260]
Aug 26 11:42:18 user nova-compute[73068]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528, portal: 172.16.0.220,3260] successful.
Aug 26 11:42:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbfe988-707c-43d6-b488-6a0e643aa887]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] <== disconnect_volume: return (344ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:42:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lazy-loading 'flavor' on Instance uuid 2881e7a6-0099-4b87-819b-c36dd3db99c8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1cbc3305-861a-43db-896f-5a39dd195c56 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.954s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.819s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:19 user nova-compute[73068]: INFO nova.compute.manager [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Terminating instance
Aug 26 11:42:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-f61d6c05-f9bc-4d0e-887b-81698ef20372 req-43ed2515-2c8e-416f-b970-cda88b202a47 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Received event network-vif-unplugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f61d6c05-f9bc-4d0e-887b-81698ef20372 req-43ed2515-2c8e-416f-b970-cda88b202a47 service nova] Acquiring lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f61d6c05-f9bc-4d0e-887b-81698ef20372 req-43ed2515-2c8e-416f-b970-cda88b202a47 service nova] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f61d6c05-f9bc-4d0e-887b-81698ef20372 req-43ed2515-2c8e-416f-b970-cda88b202a47 service nova] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-f61d6c05-f9bc-4d0e-887b-81698ef20372 req-43ed2515-2c8e-416f-b970-cda88b202a47 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] No waiting events found dispatching network-vif-unplugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-f61d6c05-f9bc-4d0e-887b-81698ef20372 req-43ed2515-2c8e-416f-b970-cda88b202a47 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Received event network-vif-unplugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:42:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Instance destroyed successfully.
Aug 26 11:42:19 user nova-compute[73068]: DEBUG nova.objects.instance [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lazy-loading 'resources' on Instance uuid 2881e7a6-0099-4b87-819b-c36dd3db99c8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-339323794',display_name='tempest-VolumesSnapshotTestJSON-instance-339323794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-339323794',id=14,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR1k2bfjI7J2GogD0yNTcPQ9pM9XPlg0bBfaD3flAAJlhWCCgv38k7bas5IQXNLF56gv7gWLJ52B5uwkha0Q0kkkX8I+hoVWfIC1XFSWNQDkhLflTg3SrPHuY1VhUTI0w==',key_name='tempest-keypair-1664709991',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:39:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='152ceb72f1e54291a5aacf0a7403e4f0',ramdisk_id='',reservation_id='r-n9c6uptw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1332483418',owner_user_name='tempest-VolumesSnapshotTestJSON-1332483418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:39:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f42e503ca2ad49479def3b68cb51a7b3',uuid=2881e7a6-0099-4b87-819b-c36dd3db99c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "address": "fa:16:3e:89:c9:f1", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8697f9a-2c", "ovs_interfaceid": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converting VIF {"id": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "address": "fa:16:3e:89:c9:f1", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8697f9a-2c", "ovs_interfaceid": "e8697f9a-2cd5-412b-b54a-7ca067065d94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=e8697f9a-2cd5-412b-b54a-7ca067065d94,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8697f9a-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG os_vif [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=e8697f9a-2cd5-412b-b54a-7ca067065d94,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8697f9a-2c') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8697f9a-2c, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:42:19 user nova-compute[73068]: INFO os_vif [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:c9:f1,bridge_name='br-int',has_traffic_filtering=True,id=e8697f9a-2cd5-412b-b54a-7ca067065d94,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8697f9a-2c')
Aug 26 11:42:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vblGekRc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:42:19 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:42:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:377fc6be-01f4-4523-8775-06c396ae0528', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:42:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[922fb3e6-4bee-4456-96cf-6f59f3c2d0a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01b2a00-7c01-420a-80a5-8db51f2d5b49]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:42:20 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:42:20 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:42:20 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:42:20 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9039a680>, {}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Disconnecting from: [] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] <== disconnect_volume: return (56ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:42:20 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Deleting instance files /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8_del
Aug 26 11:42:20 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Deletion of /opt/stack/data/nova/instances/2881e7a6-0099-4b87-819b-c36dd3db99c8_del complete
Aug 26 11:42:20 user nova-compute[73068]: INFO nova.compute.manager [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 26 11:42:20 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:42:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:21 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:21 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Took 1.09 seconds to deallocate network for instance.
Aug 26 11:42:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-a5fe9edb-6964-460c-8e6c-f1b1a94fc32a req-a80bb34b-7230-4526-9851-8a5e5f4f6866 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Received event network-vif-deleted-e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:21 user nova-compute[73068]: INFO nova.compute.manager [req-a5fe9edb-6964-460c-8e6c-f1b1a94fc32a req-a80bb34b-7230-4526-9851-8a5e5f4f6866 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Neutron deleted interface e8697f9a-2cd5-412b-b54a-7ca067065d94; detaching it from the instance and deleting it from the info cache
Aug 26 11:42:21 user nova-compute[73068]: DEBUG nova.network.neutron [req-a5fe9edb-6964-460c-8e6c-f1b1a94fc32a req-a80bb34b-7230-4526-9851-8a5e5f4f6866 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:21 user nova-compute[73068]: WARNING nova.volume.cinder [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Attachment 36a379b3-8b91-4d00-92c5-862e94dc4065 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 36a379b3-8b91-4d00-92c5-862e94dc4065. (HTTP 404) (Request-ID: req-130474c7-0a4a-404d-90a1-8397d148123d)
Aug 26 11:42:21 user nova-compute[73068]: INFO nova.compute.manager [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Took 0.04 seconds to detach 1 volumes for instance.
Aug 26 11:42:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-a5fe9edb-6964-460c-8e6c-f1b1a94fc32a req-a80bb34b-7230-4526-9851-8a5e5f4f6866 service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Detach interface failed, port_id=e8697f9a-2cd5-412b-b54a-7ca067065d94, reason: Instance 2881e7a6-0099-4b87-819b-c36dd3db99c8 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:42:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-2af3f838-d6d0-401c-b821-e64d541e7a50 req-1a63871d-93ef-4d61-8922-c56ca3915f1a service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Received event network-vif-plugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2af3f838-d6d0-401c-b821-e64d541e7a50 req-1a63871d-93ef-4d61-8922-c56ca3915f1a service nova] Acquiring lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2af3f838-d6d0-401c-b821-e64d541e7a50 req-1a63871d-93ef-4d61-8922-c56ca3915f1a service nova] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2af3f838-d6d0-401c-b821-e64d541e7a50 req-1a63871d-93ef-4d61-8922-c56ca3915f1a service nova] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-2af3f838-d6d0-401c-b821-e64d541e7a50 req-1a63871d-93ef-4d61-8922-c56ca3915f1a service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] No waiting events found dispatching network-vif-plugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:42:21 user nova-compute[73068]: WARNING nova.compute.manager [req-2af3f838-d6d0-401c-b821-e64d541e7a50 req-1a63871d-93ef-4d61-8922-c56ca3915f1a service nova] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Received unexpected event network-vif-plugged-e8697f9a-2cd5-412b-b54a-7ca067065d94 for instance with vm_state deleted and task_state None.
Aug 26 11:42:21 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:42:21 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:42:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.449s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:21 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Deleted allocations for instance 2881e7a6-0099-4b87-819b-c36dd3db99c8
Aug 26 11:42:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8e1a6256-a436-4188-9941-05169698acc3 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "2881e7a6-0099-4b87-819b-c36dd3db99c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.909s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "deb7b9f5-d717-4d73-997a-0914c56f546c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:30 user nova-compute[73068]: INFO nova.compute.manager [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Terminating instance
Aug 26 11:42:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:42:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:31 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Instance destroyed successfully.
Aug 26 11:42:31 user nova-compute[73068]: DEBUG nova.objects.instance [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lazy-loading 'resources' on Instance uuid deb7b9f5-d717-4d73-997a-0914c56f546c {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:40:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-155143880',display_name='tempest-VolumesAdminNegativeTest-server-155143880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-155143880',id=15,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:40:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1112219a9fc34797b1d9f5e872bea350',ramdisk_id='',reservation_id='r-k3uw5yw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-175851604',owner_user_name='tempest-VolumesAdminNegativeTest-175851604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:40:35Z,user_data=None,user_id='ed086ebc2de14a0f9b55c87a40f5f621',uuid=deb7b9f5-d717-4d73-997a-0914c56f546c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "address": "fa:16:3e:56:fb:f9", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d83cbe-2f", "ovs_interfaceid": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converting VIF {"id": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "address": "fa:16:3e:56:fb:f9", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08d83cbe-2f", "ovs_interfaceid": "08d83cbe-2f4d-434d-bddf-877e284a6ae1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:f9,bridge_name='br-int',has_traffic_filtering=True,id=08d83cbe-2f4d-434d-bddf-877e284a6ae1,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d83cbe-2f') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG os_vif [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:f9,bridge_name='br-int',has_traffic_filtering=True,id=08d83cbe-2f4d-434d-bddf-877e284a6ae1,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d83cbe-2f') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08d83cbe-2f, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:31 user nova-compute[73068]: INFO os_vif [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:fb:f9,bridge_name='br-int',has_traffic_filtering=True,id=08d83cbe-2f4d-434d-bddf-877e284a6ae1,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08d83cbe-2f')
Aug 26 11:42:31 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Deleting instance files /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c_del
Aug 26 11:42:31 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Deletion of /opt/stack/data/nova/instances/deb7b9f5-d717-4d73-997a-0914c56f546c_del complete
Aug 26 11:42:31 user nova-compute[73068]: INFO nova.compute.manager [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 11:42:31 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:42:31 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:42:32 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:32 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Took 1.13 seconds to deallocate network for instance.
Aug 26 11:42:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-3ddb1009-ca63-40f3-8821-2f7b593a3ce3 req-ffe6f46e-0c09-42d8-9bbe-162e46bc1204 service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Received event network-vif-deleted-08d83cbe-2f4d-434d-bddf-877e284a6ae1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:32 user nova-compute[73068]: INFO nova.compute.manager [req-3ddb1009-ca63-40f3-8821-2f7b593a3ce3 req-ffe6f46e-0c09-42d8-9bbe-162e46bc1204 service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Neutron deleted interface 08d83cbe-2f4d-434d-bddf-877e284a6ae1; detaching it from the instance and deleting it from the info cache
Aug 26 11:42:32 user nova-compute[73068]: DEBUG nova.network.neutron [req-3ddb1009-ca63-40f3-8821-2f7b593a3ce3 req-ffe6f46e-0c09-42d8-9bbe-162e46bc1204 service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-3ddb1009-ca63-40f3-8821-2f7b593a3ce3 req-ffe6f46e-0c09-42d8-9bbe-162e46bc1204 service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Detach interface failed, port_id=08d83cbe-2f4d-434d-bddf-877e284a6ae1, reason: Instance deb7b9f5-d717-4d73-997a-0914c56f546c could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:42:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:42:33 user nova-compute[73068]: INFO nova.compute.claims [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Claim successful on node user
Aug 26 11:42:33 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Deleted allocations for instance deb7b9f5-d717-4d73-997a-0914c56f546c
Aug 26 11:42:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f2e912b2-68ea-4c8b-8f02-b38d4c0414c3 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.530s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:42:33 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:42:33 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:42:33 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:42:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Creating image(s)
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "/opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "/opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG nova.policy [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5ae30c967be457c81a16fdae5b44f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb47d0358f4c5b811b316560a66214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk 1073741824" returned: 0 in 0.055s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Cannot resize image /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Ensure instance console log exists: /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:34 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050139.9257684, 2881e7a6-0099-4b87-819b-c36dd3db99c8 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:42:34 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] VM Stopped (Lifecycle Event)
Aug 26 11:42:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bd52a896-2243-411e-ac2d-8c670e28fac4 None None] [instance: 2881e7a6-0099-4b87-819b-c36dd3db99c8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:42:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-b23f766a-1776-46fe-8b36-f433115f192c req-257780bf-6db4-4891-8291-2a79a7a5b59f service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Received event network-vif-plugged-08d83cbe-2f4d-434d-bddf-877e284a6ae1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b23f766a-1776-46fe-8b36-f433115f192c req-257780bf-6db4-4891-8291-2a79a7a5b59f service nova] Acquiring lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b23f766a-1776-46fe-8b36-f433115f192c req-257780bf-6db4-4891-8291-2a79a7a5b59f service nova] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b23f766a-1776-46fe-8b36-f433115f192c req-257780bf-6db4-4891-8291-2a79a7a5b59f service nova] Lock "deb7b9f5-d717-4d73-997a-0914c56f546c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-b23f766a-1776-46fe-8b36-f433115f192c req-257780bf-6db4-4891-8291-2a79a7a5b59f service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] No waiting events found dispatching network-vif-plugged-08d83cbe-2f4d-434d-bddf-877e284a6ae1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:42:35 user nova-compute[73068]: WARNING nova.compute.manager [req-b23f766a-1776-46fe-8b36-f433115f192c req-257780bf-6db4-4891-8291-2a79a7a5b59f service nova] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Received unexpected event network-vif-plugged-08d83cbe-2f4d-434d-bddf-877e284a6ae1 for instance with vm_state deleted and task_state None.
Aug 26 11:42:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:35 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Successfully created port: 53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:42:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Successfully updated port: 53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:42:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "refresh_cache-0ad0eb14-0b3e-49f8-bc57-4beb441aa305" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:42:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquired lock "refresh_cache-0ad0eb14-0b3e-49f8-bc57-4beb441aa305" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:42:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:42:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:42:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-479ab0ba-bf43-4989-aec5-a0487e6d5fc6 req-ae029338-7616-42e2-88f3-f2861f254d61 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Received event network-changed-53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-479ab0ba-bf43-4989-aec5-a0487e6d5fc6 req-ae029338-7616-42e2-88f3-f2861f254d61 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Refreshing instance network info cache due to event network-changed-53e739a4-a092-432f-9a2b-34c901568270. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-479ab0ba-bf43-4989-aec5-a0487e6d5fc6 req-ae029338-7616-42e2-88f3-f2861f254d61 service nova] Acquiring lock "refresh_cache-0ad0eb14-0b3e-49f8-bc57-4beb441aa305" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Updating instance_info_cache with network_info: [{"id": "53e739a4-a092-432f-9a2b-34c901568270", "address": "fa:16:3e:a3:d0:46", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e739a4-a0", "ovs_interfaceid": "53e739a4-a092-432f-9a2b-34c901568270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Releasing lock "refresh_cache-0ad0eb14-0b3e-49f8-bc57-4beb441aa305" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Instance network_info: |[{"id": "53e739a4-a092-432f-9a2b-34c901568270", "address": "fa:16:3e:a3:d0:46", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e739a4-a0", "ovs_interfaceid": "53e739a4-a092-432f-9a2b-34c901568270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-479ab0ba-bf43-4989-aec5-a0487e6d5fc6 req-ae029338-7616-42e2-88f3-f2861f254d61 service nova] Acquired lock "refresh_cache-0ad0eb14-0b3e-49f8-bc57-4beb441aa305" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.network.neutron [req-479ab0ba-bf43-4989-aec5-a0487e6d5fc6 req-ae029338-7616-42e2-88f3-f2861f254d61 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Refreshing network info cache for port 53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Start _get_guest_xml network_info=[{"id": "53e739a4-a092-432f-9a2b-34c901568270", "address": "fa:16:3e:a3:d0:46", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e739a4-a0", "ovs_interfaceid": "53e739a4-a092-432f-9a2b-34c901568270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:42:37 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:42:37 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1032391490',display_name='tempest-VolumesActionsTest-instance-1032391490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1032391490',id=18,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5eb47d0358f4c5b811b316560a66214',ramdisk_id='',reservation_id='r-mfpvri3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1862177138',owner_user_name='tempest-VolumesActionsTest-1862177138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:42:34Z,user_data=None,user_id='c5ae30c967be457c81a16fdae5b44f18',uuid=0ad0eb14-0b3e-49f8-bc57-4beb441aa305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e739a4-a092-432f-9a2b-34c901568270", "address": "fa:16:3e:a3:d0:46", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e739a4-a0", "ovs_interfaceid": "53e739a4-a092-432f-9a2b-34c901568270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converting VIF {"id": "53e739a4-a092-432f-9a2b-34c901568270", "address": "fa:16:3e:a3:d0:46", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e739a4-a0", "ovs_interfaceid": "53e739a4-a092-432f-9a2b-34c901568270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d0:46,bridge_name='br-int',has_traffic_filtering=True,id=53e739a4-a092-432f-9a2b-34c901568270,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e739a4-a0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.objects.instance [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ad0eb14-0b3e-49f8-bc57-4beb441aa305 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:42:37 user nova-compute[73068]:   <uuid>0ad0eb14-0b3e-49f8-bc57-4beb441aa305</uuid>
Aug 26 11:42:37 user nova-compute[73068]:   <name>instance-00000012</name>
Aug 26 11:42:37 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:42:37 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:42:37 user nova-compute[73068]:   <metadata>
Aug 26 11:42:37 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:42:37 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:42:37 user nova-compute[73068]:       <nova:name>tempest-VolumesActionsTest-instance-1032391490</nova:name>
Aug 26 11:42:37 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:42:37</nova:creationTime>
Aug 26 11:42:37 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:42:37 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:42:37 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:42:37 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:42:37 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:42:37 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:42:37 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:42:37 user nova-compute[73068]:       <nova:owner>
Aug 26 11:42:37 user nova-compute[73068]:         <nova:user uuid="c5ae30c967be457c81a16fdae5b44f18">tempest-VolumesActionsTest-1862177138-project-member</nova:user>
Aug 26 11:42:37 user nova-compute[73068]:         <nova:project uuid="e5eb47d0358f4c5b811b316560a66214">tempest-VolumesActionsTest-1862177138</nova:project>
Aug 26 11:42:37 user nova-compute[73068]:       </nova:owner>
Aug 26 11:42:37 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:42:37 user nova-compute[73068]:       <nova:ports>
Aug 26 11:42:37 user nova-compute[73068]:         <nova:port uuid="53e739a4-a092-432f-9a2b-34c901568270">
Aug 26 11:42:37 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 11:42:37 user nova-compute[73068]:         </nova:port>
Aug 26 11:42:37 user nova-compute[73068]:       </nova:ports>
Aug 26 11:42:37 user nova-compute[73068]:     </nova:instance>
Aug 26 11:42:37 user nova-compute[73068]:   </metadata>
Aug 26 11:42:37 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:42:37 user nova-compute[73068]:     <system>
Aug 26 11:42:37 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:42:37 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:42:37 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:42:37 user nova-compute[73068]:       <entry name="serial">0ad0eb14-0b3e-49f8-bc57-4beb441aa305</entry>
Aug 26 11:42:37 user nova-compute[73068]:       <entry name="uuid">0ad0eb14-0b3e-49f8-bc57-4beb441aa305</entry>
Aug 26 11:42:37 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:42:37 user nova-compute[73068]:     </system>
Aug 26 11:42:37 user nova-compute[73068]:   </sysinfo>
Aug 26 11:42:37 user nova-compute[73068]:   <os>
Aug 26 11:42:37 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:42:37 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:42:37 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:42:37 user nova-compute[73068]:   </os>
Aug 26 11:42:37 user nova-compute[73068]:   <features>
Aug 26 11:42:37 user nova-compute[73068]:     <acpi/>
Aug 26 11:42:37 user nova-compute[73068]:     <apic/>
Aug 26 11:42:37 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:42:37 user nova-compute[73068]:   </features>
Aug 26 11:42:37 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:42:37 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:42:37 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:42:37 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:42:37 user nova-compute[73068]:   </clock>
Aug 26 11:42:37 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:42:37 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:42:37 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:42:37 user nova-compute[73068]:   </cpu>
Aug 26 11:42:37 user nova-compute[73068]:   <devices>
Aug 26 11:42:37 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:42:37 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:42:37 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk"/>
Aug 26 11:42:37 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:42:37 user nova-compute[73068]:     </disk>
Aug 26 11:42:37 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:42:37 user nova-compute[73068]:       <mac address="fa:16:3e:a3:d0:46"/>
Aug 26 11:42:37 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:42:37 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:42:37 user nova-compute[73068]:       <target dev="tap53e739a4-a0"/>
Aug 26 11:42:37 user nova-compute[73068]:     </interface>
Aug 26 11:42:37 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:42:37 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/console.log" append="off"/>
Aug 26 11:42:37 user nova-compute[73068]:     </serial>
Aug 26 11:42:37 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:42:37 user nova-compute[73068]:     <video>
Aug 26 11:42:37 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:42:37 user nova-compute[73068]:     </video>
Aug 26 11:42:37 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:42:37 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:42:37 user nova-compute[73068]:     </rng>
Aug 26 11:42:37 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:42:37 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:42:37 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:42:37 user nova-compute[73068]:     </memballoon>
Aug 26 11:42:37 user nova-compute[73068]:   </devices>
Aug 26 11:42:37 user nova-compute[73068]: </domain>
Aug 26 11:42:37 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1032391490',display_name='tempest-VolumesActionsTest-instance-1032391490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1032391490',id=18,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5eb47d0358f4c5b811b316560a66214',ramdisk_id='',reservation_id='r-mfpvri3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1862177138',owner_user_name='tempest-VolumesActionsTest-1862177138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:42:34Z,user_data=None,user_id='c5ae30c967be457c81a16fdae5b44f18',uuid=0ad0eb14-0b3e-49f8-bc57-4beb441aa305,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e739a4-a092-432f-9a2b-34c901568270", "address": "fa:16:3e:a3:d0:46", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e739a4-a0", "ovs_interfaceid": "53e739a4-a092-432f-9a2b-34c901568270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converting VIF {"id": "53e739a4-a092-432f-9a2b-34c901568270", "address": "fa:16:3e:a3:d0:46", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e739a4-a0", "ovs_interfaceid": "53e739a4-a092-432f-9a2b-34c901568270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d0:46,bridge_name='br-int',has_traffic_filtering=True,id=53e739a4-a092-432f-9a2b-34c901568270,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e739a4-a0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG os_vif [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d0:46,bridge_name='br-int',has_traffic_filtering=True,id=53e739a4-a092-432f-9a2b-34c901568270,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e739a4-a0') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53e739a4-a0, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53e739a4-a0, col_values=(('external_ids', {'iface-id': '53e739a4-a092-432f-9a2b-34c901568270', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:d0:46', 'vm-uuid': '0ad0eb14-0b3e-49f8-bc57-4beb441aa305'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:37 user nova-compute[73068]: INFO os_vif [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d0:46,bridge_name='br-int',has_traffic_filtering=True,id=53e739a4-a092-432f-9a2b-34c901568270,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e739a4-a0')
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] No VIF found with MAC fa:16:3e:a3:d0:46, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.network.neutron [req-479ab0ba-bf43-4989-aec5-a0487e6d5fc6 req-ae029338-7616-42e2-88f3-f2861f254d61 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Updated VIF entry in instance network info cache for port 53e739a4-a092-432f-9a2b-34c901568270. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG nova.network.neutron [req-479ab0ba-bf43-4989-aec5-a0487e6d5fc6 req-ae029338-7616-42e2-88f3-f2861f254d61 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Updating instance_info_cache with network_info: [{"id": "53e739a4-a092-432f-9a2b-34c901568270", "address": "fa:16:3e:a3:d0:46", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e739a4-a0", "ovs_interfaceid": "53e739a4-a092-432f-9a2b-34c901568270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-479ab0ba-bf43-4989-aec5-a0487e6d5fc6 req-ae029338-7616-42e2-88f3-f2861f254d61 service nova] Releasing lock "refresh_cache-0ad0eb14-0b3e-49f8-bc57-4beb441aa305" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-6019d48f-afb1-4e56-bed2-ed24c6c267c7 req-aeea07c4-a3d7-4625-866d-708786f5186d service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Received event network-vif-plugged-53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6019d48f-afb1-4e56-bed2-ed24c6c267c7 req-aeea07c4-a3d7-4625-866d-708786f5186d service nova] Acquiring lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6019d48f-afb1-4e56-bed2-ed24c6c267c7 req-aeea07c4-a3d7-4625-866d-708786f5186d service nova] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6019d48f-afb1-4e56-bed2-ed24c6c267c7 req-aeea07c4-a3d7-4625-866d-708786f5186d service nova] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-6019d48f-afb1-4e56-bed2-ed24c6c267c7 req-aeea07c4-a3d7-4625-866d-708786f5186d service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] No waiting events found dispatching network-vif-plugged-53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:42:39 user nova-compute[73068]: WARNING nova.compute.manager [req-6019d48f-afb1-4e56-bed2-ed24c6c267c7 req-aeea07c4-a3d7-4625-866d-708786f5186d service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Received unexpected event network-vif-plugged-53e739a4-a092-432f-9a2b-34c901568270 for instance with vm_state building and task_state spawning.
Aug 26 11:42:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 11:42:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050161.4024768, 0ad0eb14-0b3e-49f8-bc57-4beb441aa305 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:42:41 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] VM Resumed (Lifecycle Event)
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:42:41 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Instance spawned successfully.
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:42:41 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050161.4055433, 0ad0eb14-0b3e-49f8-bc57-4beb441aa305 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:42:41 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] VM Started (Lifecycle Event)
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:42:41 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:42:41 user nova-compute[73068]: INFO nova.compute.manager [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Took 7.51 seconds to spawn the instance on the hypervisor.
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:42:41 user nova-compute[73068]: INFO nova.compute.manager [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Took 8.38 seconds to build instance.
Aug 26 11:42:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b010766-0aa0-4468-b062-8bbb9780ba3c tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.507s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-b14c0cf6-4b95-47c3-ac34-ca3272dff549 req-2967d54d-7462-4ebf-a21a-5406e2bf6fa7 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Received event network-vif-plugged-53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b14c0cf6-4b95-47c3-ac34-ca3272dff549 req-2967d54d-7462-4ebf-a21a-5406e2bf6fa7 service nova] Acquiring lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b14c0cf6-4b95-47c3-ac34-ca3272dff549 req-2967d54d-7462-4ebf-a21a-5406e2bf6fa7 service nova] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b14c0cf6-4b95-47c3-ac34-ca3272dff549 req-2967d54d-7462-4ebf-a21a-5406e2bf6fa7 service nova] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-b14c0cf6-4b95-47c3-ac34-ca3272dff549 req-2967d54d-7462-4ebf-a21a-5406e2bf6fa7 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] No waiting events found dispatching network-vif-plugged-53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:42:41 user nova-compute[73068]: WARNING nova.compute.manager [req-b14c0cf6-4b95-47c3-ac34-ca3272dff549 req-2967d54d-7462-4ebf-a21a-5406e2bf6fa7 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Received unexpected event network-vif-plugged-53e739a4-a092-432f-9a2b-34c901568270 for instance with vm_state active and task_state None.
Aug 26 11:42:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:44 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:44 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:44 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:42:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "937978de-8e83-42e7-b906-ccc226924f1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "937978de-8e83-42e7-b906-ccc226924f1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:46 user nova-compute[73068]: INFO nova.compute.manager [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Terminating instance
Aug 26 11:42:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050151.6919482, deb7b9f5-d717-4d73-997a-0914c56f546c => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:42:46 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] VM Stopped (Lifecycle Event)
Aug 26 11:42:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b4457a54-2acb-4580-964b-9d589845f3fb None None] [instance: deb7b9f5-d717-4d73-997a-0914c56f546c] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:42:46 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Instance destroyed successfully.
Aug 26 11:42:46 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'resources' on Instance uuid 937978de-8e83-42e7-b906-ccc226924f1f {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1073269416',display_name='tempest-AttachVolumeNegativeTest-server-1073269416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1073269416',id=1,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOLNmZFejabsRCsSjaAfTQYfq2UrsHUOJ8+kjHnqWqVDD6InojY6380HREoVS/sgY1vzdwgCinhaEFDHYgMyHat0kngtKalKbyPwsE51i2O0dnIjEF7IsgNiB/Zybg2ZQ==',key_name='tempest-keypair-148214339',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-in5uj5gm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=937978de-8e83-42e7-b906-ccc226924f1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "address": "fa:16:3e:f4:ed:38", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee146c0d-fc", "ovs_interfaceid": "ee146c0d-fc52-4402-9c39-b4957128f3ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=ee146c0d-fc52-4402-9c39-b4957128f3ef,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee146c0d-fc') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG os_vif [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=ee146c0d-fc52-4402-9c39-b4957128f3ef,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee146c0d-fc') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee146c0d-fc, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:42:46 user nova-compute[73068]: INFO os_vif [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ed:38,bridge_name='br-int',has_traffic_filtering=True,id=ee146c0d-fc52-4402-9c39-b4957128f3ef,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee146c0d-fc')
Aug 26 11:42:46 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Deleting instance files /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f_del
Aug 26 11:42:46 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Deletion of /opt/stack/data/nova/instances/937978de-8e83-42e7-b906-ccc226924f1f_del complete
Aug 26 11:42:46 user nova-compute[73068]: INFO nova.compute.manager [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 11:42:46 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:42:46 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:48 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Took 1.70 seconds to deallocate network for instance.
Aug 26 11:42:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-c023e93e-2c48-46e2-be9e-e14b821f5fad req-8d4bd975-d431-4773-a892-5bd535c4c90f service nova] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Received event network-vif-deleted-ee146c0d-fc52-4402-9c39-b4957128f3ef {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 11:42:48 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.682s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:49 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Deleted allocations for instance 937978de-8e83-42e7-b906-ccc226924f1f
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1862ecf3-fba3-4e32-9ead-4c0f1eda7b7e tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "937978de-8e83-42e7-b906-ccc226924f1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.610s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "a11f0d98-3177-4345-8d54-b76b8a348f21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:42:50 user nova-compute[73068]: INFO nova.compute.claims [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Claim successful on node user
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:50 user nova-compute[73068]: INFO nova.compute.manager [None req-e7d3269c-777b-48c3-a44e-99cb237f8646 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Unrescuing
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e7d3269c-777b-48c3-a44e-99cb237f8646 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e7d3269c-777b-48c3-a44e-99cb237f8646 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquired lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e7d3269c-777b-48c3-a44e-99cb237f8646 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:50 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:42:50 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Creating image(s)
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "/opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "/opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "/opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:50 user nova-compute[73068]: DEBUG nova.policy [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dbdaab1cbb4446b8709fe4526c10317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b517fdd290f5457f99b6cc9423a809b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e7d3269c-777b-48c3-a44e-99cb237f8646 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating instance_info_cache with network_info: [{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e7d3269c-777b-48c3-a44e-99cb237f8646 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Releasing lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e7d3269c-777b-48c3-a44e-99cb237f8646 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'flavor' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.230s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk 1073741824" returned: 0 in 0.055s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-488b18ae-b5ca-4575-8537-c76b67fbfc8a req-ab3489df-5a01-4d1b-98b5-04b334f8aa07 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-unplugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-488b18ae-b5ca-4575-8537-c76b67fbfc8a req-ab3489df-5a01-4d1b-98b5-04b334f8aa07 service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-488b18ae-b5ca-4575-8537-c76b67fbfc8a req-ab3489df-5a01-4d1b-98b5-04b334f8aa07 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-488b18ae-b5ca-4575-8537-c76b67fbfc8a req-ab3489df-5a01-4d1b-98b5-04b334f8aa07 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-488b18ae-b5ca-4575-8537-c76b67fbfc8a req-ab3489df-5a01-4d1b-98b5-04b334f8aa07 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-unplugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:42:51 user nova-compute[73068]: WARNING nova.compute.manager [req-488b18ae-b5ca-4575-8537-c76b67fbfc8a req-ab3489df-5a01-4d1b-98b5-04b334f8aa07 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received unexpected event network-vif-unplugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with vm_state rescued and task_state unrescuing.
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Cannot resize image /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Ensure instance console log exists: /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:52 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Instance destroyed successfully.
Aug 26 11:42:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Successfully created port: f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for 2e64329a-4cf4-4f10-bbb9-4bb50754841a due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050175.6862094, 2e64329a-4cf4-4f10-bbb9-4bb50754841a => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:42:56 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] VM Resumed (Lifecycle Event)
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e7d3269c-777b-48c3-a44e-99cb237f8646 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-40a542a8-81ce-459b-87b5-6a05938c8f7a req-6ec7dca5-c7e6-41cb-960f-f6c76ece184f service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-changed-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-40a542a8-81ce-459b-87b5-6a05938c8f7a req-6ec7dca5-c7e6-41cb-960f-f6c76ece184f service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Refreshing instance network info cache due to event network-changed-633ed4fe-2630-42c2-b0ff-dba262056dad. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-40a542a8-81ce-459b-87b5-6a05938c8f7a req-6ec7dca5-c7e6-41cb-960f-f6c76ece184f service nova] Acquiring lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-40a542a8-81ce-459b-87b5-6a05938c8f7a req-6ec7dca5-c7e6-41cb-960f-f6c76ece184f service nova] Acquired lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.network.neutron [req-40a542a8-81ce-459b-87b5-6a05938c8f7a req-6ec7dca5-c7e6-41cb-960f-f6c76ece184f service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Refreshing network info cache for port 633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-f5b1a86b-472f-4398-84b6-41279422bdcb req-85967b75-79e4-4905-aa19-5f04c9c40e3f service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f5b1a86b-472f-4398-84b6-41279422bdcb req-85967b75-79e4-4905-aa19-5f04c9c40e3f service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f5b1a86b-472f-4398-84b6-41279422bdcb req-85967b75-79e4-4905-aa19-5f04c9c40e3f service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f5b1a86b-472f-4398-84b6-41279422bdcb req-85967b75-79e4-4905-aa19-5f04c9c40e3f service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-f5b1a86b-472f-4398-84b6-41279422bdcb req-85967b75-79e4-4905-aa19-5f04c9c40e3f service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:42:56 user nova-compute[73068]: WARNING nova.compute.manager [req-f5b1a86b-472f-4398-84b6-41279422bdcb req-85967b75-79e4-4905-aa19-5f04c9c40e3f service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received unexpected event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with vm_state rescued and task_state unrescuing.
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-57f809a3-705b-462a-a83a-0d9a9b68ae61 req-68cd517e-6c54-43ce-b773-3ce5cd3fd756 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-changed-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-57f809a3-705b-462a-a83a-0d9a9b68ae61 req-68cd517e-6c54-43ce-b773-3ce5cd3fd756 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Refreshing instance network info cache due to event network-changed-633ed4fe-2630-42c2-b0ff-dba262056dad. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-57f809a3-705b-462a-a83a-0d9a9b68ae61 req-68cd517e-6c54-43ce-b773-3ce5cd3fd756 service nova] Acquiring lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:42:56 user nova-compute[73068]: WARNING nova.compute.manager [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received unexpected event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with vm_state rescued and task_state unrescuing.
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:42:56 user nova-compute[73068]: WARNING nova.compute.manager [req-8bbc4a42-3a9b-4b30-98df-fa3bb15f7e51 req-054bc849-86d3-4148-92d2-b6dd79d6f061 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received unexpected event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with vm_state rescued and task_state unrescuing.
Aug 26 11:42:56 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:42:56 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=25.600772857666016GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "792b5efb-63fa-4e87-b114-61de6180b2c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:42:56 user nova-compute[73068]: INFO nova.compute.manager [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Detaching volume 7c19634f-40b5-4e36-be22-372a0447f545
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:42:56 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050175.6880085, 2e64329a-4cf4-4f10-bbb9-4bb50754841a => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:42:56 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] VM Started (Lifecycle Event)
Aug 26 11:42:56 user nova-compute[73068]: INFO nova.virt.block_device [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Attempting to driver detach volume 7c19634f-40b5-4e36-be22-372a0447f545 from mountpoint /dev/vdb
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Attempting to detach device vdb from instance 792b5efb-63fa-4e87-b114-61de6180b2c6 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:42:56 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:42:56 user nova-compute[73068]:   <source dev="/dev/sdj"/>
Aug 26 11:42:56 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:42:56 user nova-compute[73068]:   <serial>7c19634f-40b5-4e36-be22-372a0447f545</serial>
Aug 26 11:42:56 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:42:56 user nova-compute[73068]: </disk>
Aug 26 11:42:56 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance fba812b3-7791-463f-9c86-a51ae7a7457d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 792b5efb-63fa-4e87-b114-61de6180b2c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance cdb99751-19de-4c5d-a907-c26171588ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a39507fb-9897-4e5d-8217-390785208d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 0ad0eb14-0b3e-49f8-bc57-4beb441aa305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:42:56 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Successfully detached device vdb from instance 792b5efb-63fa-4e87-b114-61de6180b2c6 from the persistent domain config.
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 792b5efb-63fa-4e87-b114-61de6180b2c6 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:42:56 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:42:56 user nova-compute[73068]:   <source dev="/dev/sdj"/>
Aug 26 11:42:56 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:42:56 user nova-compute[73068]:   <serial>7c19634f-40b5-4e36-be22-372a0447f545</serial>
Aug 26 11:42:56 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:42:56 user nova-compute[73068]: </disk>
Aug 26 11:42:56 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050176.8685546, 792b5efb-63fa-4e87-b114-61de6180b2c6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 792b5efb-63fa-4e87-b114-61de6180b2c6 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:42:56 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Successfully detached device vdb from instance 792b5efb-63fa-4e87-b114-61de6180b2c6 from the live domain config.
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cXJNwHpY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:42:56 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:42:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea7ea8c-886a-4914-9449-0f8f12959e35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.network.neutron [req-40a542a8-81ce-459b-87b5-6a05938c8f7a req-6ec7dca5-c7e6-41cb-960f-f6c76ece184f service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updated VIF entry in instance network info cache for port 633ed4fe-2630-42c2-b0ff-dba262056dad. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.network.neutron [req-40a542a8-81ce-459b-87b5-6a05938c8f7a req-6ec7dca5-c7e6-41cb-960f-f6c76ece184f service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating instance_info_cache with network_info: [{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-40a542a8-81ce-459b-87b5-6a05938c8f7a req-6ec7dca5-c7e6-41cb-960f-f6c76ece184f service nova] Releasing lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2588149-c1e9-473f-a754-cf54c5af1dc5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-57f809a3-705b-462a-a83a-0d9a9b68ae61 req-68cd517e-6c54-43ce-b773-3ce5cd3fd756 service nova] Acquired lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG nova.network.neutron [req-57f809a3-705b-462a-a83a-0d9a9b68ae61 req-68cd517e-6c54-43ce-b773-3ce5cd3fd756 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Refreshing network info cache for port 633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:42:56 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:42:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 (non-flash)
Aug 26 11:42:56 user nova-compute[73068]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:42:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9025a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545'): ({'sdj'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Removing single pathed devices sdj {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:42:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf17b11-f956-4373-b471-7361b2645c1d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[df811fd5-c4f3-4ad6-9898-72dc308a4153]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Flushing IO for device /dev/sdj {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1c56a1-7265-4efc-922f-eb89ecca3d89]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.049s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0454ac-5d91-4c5c-b933-1ccf2ec314dd]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] SCSI volumes sdj have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc8cce1-9495-436c-856c-ba6a238b603e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[781d84cc-e524-448b-aa31-4ea6545ac031]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545, portal: 172.16.0.220,3260]
Aug 26 11:42:57 user nova-compute[73068]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545, portal: 172.16.0.220,3260] successful.
Aug 26 11:42:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c19634f-40b5-4e36-be22-372a0447f545 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[329b7700-de99-48b5-b560-229b3c606d98]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] <== disconnect_volume: return (351ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Successfully updated port: f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquired lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.compute.manager [req-11b19a69-40a1-41a6-89af-dbe6a64a1e5a req-f103be58-64ac-4c83-aa76-0f3b0184a94e service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received event network-changed-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.compute.manager [req-11b19a69-40a1-41a6-89af-dbe6a64a1e5a req-f103be58-64ac-4c83-aa76-0f3b0184a94e service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Refreshing instance network info cache due to event network-changed-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11b19a69-40a1-41a6-89af-dbe6a64a1e5a req-f103be58-64ac-4c83-aa76-0f3b0184a94e service nova] Acquiring lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.network.neutron [req-57f809a3-705b-462a-a83a-0d9a9b68ae61 req-68cd517e-6c54-43ce-b773-3ce5cd3fd756 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updated VIF entry in instance network info cache for port 633ed4fe-2630-42c2-b0ff-dba262056dad. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.network.neutron [req-57f809a3-705b-462a-a83a-0d9a9b68ae61 req-68cd517e-6c54-43ce-b773-3ce5cd3fd756 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating instance_info_cache with network_info: [{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-57f809a3-705b-462a-a83a-0d9a9b68ae61 req-68cd517e-6c54-43ce-b773-3ce5cd3fd756 service nova] Releasing lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updating instance_info_cache with network_info: [{"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Releasing lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Instance network_info: |[{"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11b19a69-40a1-41a6-89af-dbe6a64a1e5a req-f103be58-64ac-4c83-aa76-0f3b0184a94e service nova] Acquired lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.network.neutron [req-11b19a69-40a1-41a6-89af-dbe6a64a1e5a req-f103be58-64ac-4c83-aa76-0f3b0184a94e service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Refreshing network info cache for port f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Start _get_guest_xml network_info=[{"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:42:57 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:42:57 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-24310409',display_name='tempest-ServerActionsTestOtherA-server-24310409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-24310409',id=19,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEidFbMuWm3Ff85RQNGqsibmn5TiGb1b1MKD1SbY+915mQ5QKEZYxmDBFmRdORKitoTVm8qIYWV2p9ti1GszyrhsioU3qq34YTLHcZIRxComRJG1yG+FKs8AGlXLqDxQ4Q==',key_name='tempest-keypair-1757051288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-84j8njnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=a11f0d98-3177-4345-8d54-b76b8a348f21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e1cc41-b6') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:42:57 user nova-compute[73068]: DEBUG nova.objects.instance [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'pci_devices' on Instance uuid a11f0d98-3177-4345-8d54-b76b8a348f21 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:42:58 user nova-compute[73068]:   <uuid>a11f0d98-3177-4345-8d54-b76b8a348f21</uuid>
Aug 26 11:42:58 user nova-compute[73068]:   <name>instance-00000013</name>
Aug 26 11:42:58 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:42:58 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:42:58 user nova-compute[73068]:   <metadata>
Aug 26 11:42:58 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:42:58 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:42:58 user nova-compute[73068]:       <nova:name>tempest-ServerActionsTestOtherA-server-24310409</nova:name>
Aug 26 11:42:58 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:42:57</nova:creationTime>
Aug 26 11:42:58 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:42:58 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:42:58 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:42:58 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:42:58 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:42:58 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:42:58 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:42:58 user nova-compute[73068]:       <nova:owner>
Aug 26 11:42:58 user nova-compute[73068]:         <nova:user uuid="9dbdaab1cbb4446b8709fe4526c10317">tempest-ServerActionsTestOtherA-281587706-project-member</nova:user>
Aug 26 11:42:58 user nova-compute[73068]:         <nova:project uuid="b517fdd290f5457f99b6cc9423a809b5">tempest-ServerActionsTestOtherA-281587706</nova:project>
Aug 26 11:42:58 user nova-compute[73068]:       </nova:owner>
Aug 26 11:42:58 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:42:58 user nova-compute[73068]:       <nova:ports>
Aug 26 11:42:58 user nova-compute[73068]:         <nova:port uuid="f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111">
Aug 26 11:42:58 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 11:42:58 user nova-compute[73068]:         </nova:port>
Aug 26 11:42:58 user nova-compute[73068]:       </nova:ports>
Aug 26 11:42:58 user nova-compute[73068]:     </nova:instance>
Aug 26 11:42:58 user nova-compute[73068]:   </metadata>
Aug 26 11:42:58 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:42:58 user nova-compute[73068]:     <system>
Aug 26 11:42:58 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:42:58 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:42:58 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:42:58 user nova-compute[73068]:       <entry name="serial">a11f0d98-3177-4345-8d54-b76b8a348f21</entry>
Aug 26 11:42:58 user nova-compute[73068]:       <entry name="uuid">a11f0d98-3177-4345-8d54-b76b8a348f21</entry>
Aug 26 11:42:58 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:42:58 user nova-compute[73068]:     </system>
Aug 26 11:42:58 user nova-compute[73068]:   </sysinfo>
Aug 26 11:42:58 user nova-compute[73068]:   <os>
Aug 26 11:42:58 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:42:58 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:42:58 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:42:58 user nova-compute[73068]:   </os>
Aug 26 11:42:58 user nova-compute[73068]:   <features>
Aug 26 11:42:58 user nova-compute[73068]:     <acpi/>
Aug 26 11:42:58 user nova-compute[73068]:     <apic/>
Aug 26 11:42:58 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:42:58 user nova-compute[73068]:   </features>
Aug 26 11:42:58 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:42:58 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:42:58 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:42:58 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:42:58 user nova-compute[73068]:   </clock>
Aug 26 11:42:58 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:42:58 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:42:58 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:42:58 user nova-compute[73068]:   </cpu>
Aug 26 11:42:58 user nova-compute[73068]:   <devices>
Aug 26 11:42:58 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:42:58 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:42:58 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk"/>
Aug 26 11:42:58 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:42:58 user nova-compute[73068]:     </disk>
Aug 26 11:42:58 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:42:58 user nova-compute[73068]:       <mac address="fa:16:3e:76:6e:44"/>
Aug 26 11:42:58 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:42:58 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:42:58 user nova-compute[73068]:       <target dev="tapf9e1cc41-b6"/>
Aug 26 11:42:58 user nova-compute[73068]:     </interface>
Aug 26 11:42:58 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:42:58 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/console.log" append="off"/>
Aug 26 11:42:58 user nova-compute[73068]:     </serial>
Aug 26 11:42:58 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:42:58 user nova-compute[73068]:     <video>
Aug 26 11:42:58 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:42:58 user nova-compute[73068]:     </video>
Aug 26 11:42:58 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:42:58 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:42:58 user nova-compute[73068]:     </rng>
Aug 26 11:42:58 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:42:58 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:42:58 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:42:58 user nova-compute[73068]:     </memballoon>
Aug 26 11:42:58 user nova-compute[73068]:   </devices>
Aug 26 11:42:58 user nova-compute[73068]: </domain>
Aug 26 11:42:58 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-24310409',display_name='tempest-ServerActionsTestOtherA-server-24310409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-24310409',id=19,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEidFbMuWm3Ff85RQNGqsibmn5TiGb1b1MKD1SbY+915mQ5QKEZYxmDBFmRdORKitoTVm8qIYWV2p9ti1GszyrhsioU3qq34YTLHcZIRxComRJG1yG+FKs8AGlXLqDxQ4Q==',key_name='tempest-keypair-1757051288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-84j8njnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=a11f0d98-3177-4345-8d54-b76b8a348f21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e1cc41-b6') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG os_vif [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e1cc41-b6') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9e1cc41-b6, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9e1cc41-b6, col_values=(('external_ids', {'iface-id': 'f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:6e:44', 'vm-uuid': 'a11f0d98-3177-4345-8d54-b76b8a348f21'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:58 user nova-compute[73068]: INFO os_vif [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e1cc41-b6')
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No VIF found with MAC fa:16:3e:76:6e:44, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lazy-loading 'flavor' on Instance uuid 792b5efb-63fa-4e87-b114-61de6180b2c6 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a3f49ce8-728e-421f-b13d-cfb0b0d3854e tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.160s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.network.neutron [req-11b19a69-40a1-41a6-89af-dbe6a64a1e5a req-f103be58-64ac-4c83-aa76-0f3b0184a94e service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updated VIF entry in instance network info cache for port f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.network.neutron [req-11b19a69-40a1-41a6-89af-dbe6a64a1e5a req-f103be58-64ac-4c83-aa76-0f3b0184a94e service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updating instance_info_cache with network_info: [{"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-11b19a69-40a1-41a6-89af-dbe6a64a1e5a req-f103be58-64ac-4c83-aa76-0f3b0184a94e service nova] Releasing lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:42:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Skipping network cache update for instance because it is Building. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 11:42:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:42:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:42:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:42:59 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid fba812b3-7791-463f-9c86-a51ae7a7457d {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:42:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:42:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Updating instance_info_cache with network_info: [{"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid fba812b3-7791-463f-9c86-a51ae7a7457d {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 792b5efb-63fa-4e87-b114-61de6180b2c6 {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 0ad0eb14-0b3e-49f8-bc57-4beb441aa305 {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid a11f0d98-3177-4345-8d54-b76b8a348f21 {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "fba812b3-7791-463f-9c86-a51ae7a7457d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "792b5efb-63fa-4e87-b114-61de6180b2c6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "a39507fb-9897-4e5d-8217-390785208d52" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "a11f0d98-3177-4345-8d54-b76b8a348f21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-ebdce21a-913d-45c4-ba90-6b8bd7c864cd req-ddb4fc38-a6e4-4b3b-a7a6-a3934a23c25f service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received event network-vif-plugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ebdce21a-913d-45c4-ba90-6b8bd7c864cd req-ddb4fc38-a6e4-4b3b-a7a6-a3934a23c25f service nova] Acquiring lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ebdce21a-913d-45c4-ba90-6b8bd7c864cd req-ddb4fc38-a6e4-4b3b-a7a6-a3934a23c25f service nova] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ebdce21a-913d-45c4-ba90-6b8bd7c864cd req-ddb4fc38-a6e4-4b3b-a7a6-a3934a23c25f service nova] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-ebdce21a-913d-45c4-ba90-6b8bd7c864cd req-ddb4fc38-a6e4-4b3b-a7a6-a3934a23c25f service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] No waiting events found dispatching network-vif-plugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:00 user nova-compute[73068]: WARNING nova.compute.manager [req-ebdce21a-913d-45c4-ba90-6b8bd7c864cd req-ddb4fc38-a6e4-4b3b-a7a6-a3934a23c25f service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received unexpected event network-vif-plugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 for instance with vm_state building and task_state spawning.
Aug 26 11:43:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "a39507fb-9897-4e5d-8217-390785208d52" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:01 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050166.8183396, 937978de-8e83-42e7-b906-ccc226924f1f => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:43:01 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] VM Stopped (Lifecycle Event)
Aug 26 11:43:01 user nova-compute[73068]: DEBUG nova.compute.manager [None req-27648ec7-5a8f-4276-8b62-9e614959a647 None None] [instance: 937978de-8e83-42e7-b906-ccc226924f1f] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-e064bdca-d7de-4004-b9df-056419349893 req-b0d8605d-16e1-49a0-8e58-fde436727152 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received event network-vif-plugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e064bdca-d7de-4004-b9df-056419349893 req-b0d8605d-16e1-49a0-8e58-fde436727152 service nova] Acquiring lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e064bdca-d7de-4004-b9df-056419349893 req-b0d8605d-16e1-49a0-8e58-fde436727152 service nova] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e064bdca-d7de-4004-b9df-056419349893 req-b0d8605d-16e1-49a0-8e58-fde436727152 service nova] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-e064bdca-d7de-4004-b9df-056419349893 req-b0d8605d-16e1-49a0-8e58-fde436727152 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] No waiting events found dispatching network-vif-plugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:02 user nova-compute[73068]: WARNING nova.compute.manager [req-e064bdca-d7de-4004-b9df-056419349893 req-b0d8605d-16e1-49a0-8e58-fde436727152 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received unexpected event network-vif-plugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 for instance with vm_state building and task_state spawning.
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050182.5036385, a11f0d98-3177-4345-8d54-b76b8a348f21 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:43:02 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] VM Resumed (Lifecycle Event)
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:43:02 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Instance spawned successfully.
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:02 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050182.5096302, a11f0d98-3177-4345-8d54-b76b8a348f21 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:43:02 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] VM Started (Lifecycle Event)
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:43:02 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:43:02 user nova-compute[73068]: INFO nova.compute.manager [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Took 11.79 seconds to spawn the instance on the hypervisor.
Aug 26 11:43:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:02 user nova-compute[73068]: INFO nova.compute.manager [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Took 12.85 seconds to build instance.
Aug 26 11:43:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ac02fb31-07e7-46ae-ba54-8b696ef71931 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.959s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.500s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:02 user nova-compute[73068]: INFO nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:43:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-8b81c44e-36f7-4985-91f3-7f043762b88c req-e724a6c5-410d-4fd0-8d0d-8a71300b400a service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-changed-8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-8b81c44e-36f7-4985-91f3-7f043762b88c req-e724a6c5-410d-4fd0-8d0d-8a71300b400a service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Refreshing instance network info cache due to event network-changed-8d1782f8-3600-4a40-8d7a-c90fa0af9940. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:43:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8b81c44e-36f7-4985-91f3-7f043762b88c req-e724a6c5-410d-4fd0-8d0d-8a71300b400a service nova] Acquiring lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8b81c44e-36f7-4985-91f3-7f043762b88c req-e724a6c5-410d-4fd0-8d0d-8a71300b400a service nova] Acquired lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:12 user nova-compute[73068]: DEBUG nova.network.neutron [req-8b81c44e-36f7-4985-91f3-7f043762b88c req-e724a6c5-410d-4fd0-8d0d-8a71300b400a service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Refreshing network info cache for port 8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:43:12 user nova-compute[73068]: DEBUG nova.network.neutron [req-8b81c44e-36f7-4985-91f3-7f043762b88c req-e724a6c5-410d-4fd0-8d0d-8a71300b400a service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updated VIF entry in instance network info cache for port 8d1782f8-3600-4a40-8d7a-c90fa0af9940. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:43:12 user nova-compute[73068]: DEBUG nova.network.neutron [req-8b81c44e-36f7-4985-91f3-7f043762b88c req-e724a6c5-410d-4fd0-8d0d-8a71300b400a service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updating instance_info_cache with network_info: [{"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8b81c44e-36f7-4985-91f3-7f043762b88c req-e724a6c5-410d-4fd0-8d0d-8a71300b400a service nova] Releasing lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "interface-cdb99751-19de-4c5d-a907-c26171588ac8-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "interface-cdb99751-19de-4c5d-a907-c26171588ac8-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:12 user nova-compute[73068]: DEBUG nova.objects.instance [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lazy-loading 'flavor' on Instance uuid cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:13 user nova-compute[73068]: DEBUG nova.objects.instance [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lazy-loading 'pci_requests' on Instance uuid cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:13 user nova-compute[73068]: DEBUG nova.objects.base [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Object Instance<cdb99751-19de-4c5d-a907-c26171588ac8> lazy-loaded attributes: flavor,pci_requests {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:43:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:43:13 user nova-compute[73068]: DEBUG nova.policy [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f4f185d03b044309bab5ec41ecefdf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2388755cf904f42b3d230d79ec6872d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:43:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Successfully created port: 46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:43:14 user nova-compute[73068]: DEBUG nova.network.neutron [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Successfully updated port: 46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:43:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquired lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:14 user nova-compute[73068]: DEBUG nova.network.neutron [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:43:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-8c7e98bf-39af-4160-bcf6-04b2bd6978d3 req-3ddea7cc-e8b2-47e1-8859-0362091c5fc9 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-changed-46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-8c7e98bf-39af-4160-bcf6-04b2bd6978d3 req-3ddea7cc-e8b2-47e1-8859-0362091c5fc9 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Refreshing instance network info cache due to event network-changed-46c67a03-2cf3-4345-b194-cb82869cd2ae. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:43:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c7e98bf-39af-4160-bcf6-04b2bd6978d3 req-3ddea7cc-e8b2-47e1-8859-0362091c5fc9 service nova] Acquiring lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updating instance_info_cache with network_info: [{"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Releasing lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c7e98bf-39af-4160-bcf6-04b2bd6978d3 req-3ddea7cc-e8b2-47e1-8859-0362091c5fc9 service nova] Acquired lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG nova.network.neutron [req-8c7e98bf-39af-4160-bcf6-04b2bd6978d3 req-3ddea7cc-e8b2-47e1-8859-0362091c5fc9 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Refreshing network info cache for port 46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2100496070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2100496070',id=16,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKbySJmVWh9UQ7qb3tUFqXAG4F4u73SvfWieL2FnPT9HdG8s0mzeP8XQ+eMqOdGsZsgImfuW6s2qjo030oPbO+cr3zcJ8y7QBNnWq0FqFvKKQfT+n/6uIS6SeAzAbYcrQ==',key_name='tempest-keypair-1068818479',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2388755cf904f42b3d230d79ec6872d',ramdisk_id='',reservation_id='r-ttxk903y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-614082727',owner_user_name='tempest-TaggedAttachmentsTest-614082727-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4f185d03b044309bab5ec41ecefdf0',uuid=cdb99751-19de-4c5d-a907-c26171588ac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converting VIF {"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG os_vif [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46c67a03-2c, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46c67a03-2c, col_values=(('external_ids', {'iface-id': '46c67a03-2cf3-4345-b194-cb82869cd2ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:73:f9', 'vm-uuid': 'cdb99751-19de-4c5d-a907-c26171588ac8'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:15 user nova-compute[73068]: INFO os_vif [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c')
Aug 26 11:43:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2100496070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2100496070',id=16,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKbySJmVWh9UQ7qb3tUFqXAG4F4u73SvfWieL2FnPT9HdG8s0mzeP8XQ+eMqOdGsZsgImfuW6s2qjo030oPbO+cr3zcJ8y7QBNnWq0FqFvKKQfT+n/6uIS6SeAzAbYcrQ==',key_name='tempest-keypair-1068818479',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e2388755cf904f42b3d230d79ec6872d',ramdisk_id='',reservation_id='r-ttxk903y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-614082727',owner_user_name='tempest-TaggedAttachmentsTest-614082727-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4f185d03b044309bab5ec41ecefdf0',uuid=cdb99751-19de-4c5d-a907-c26171588ac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converting VIF {"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] attach device xml: <interface type="ethernet">
Aug 26 11:43:15 user nova-compute[73068]:   <mac address="fa:16:3e:e8:73:f9"/>
Aug 26 11:43:15 user nova-compute[73068]:   <model type="virtio"/>
Aug 26 11:43:15 user nova-compute[73068]:   <mtu size="1442"/>
Aug 26 11:43:15 user nova-compute[73068]:   <target dev="tap46c67a03-2c"/>
Aug 26 11:43:15 user nova-compute[73068]: </interface>
Aug 26 11:43:15 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-18d698e3-a6d2-4573-8131-64461796fa04 req-86db4da4-d622-4ae8-a3fa-ff5879677b77 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-vif-plugged-46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-18d698e3-a6d2-4573-8131-64461796fa04 req-86db4da4-d622-4ae8-a3fa-ff5879677b77 service nova] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-18d698e3-a6d2-4573-8131-64461796fa04 req-86db4da4-d622-4ae8-a3fa-ff5879677b77 service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-18d698e3-a6d2-4573-8131-64461796fa04 req-86db4da4-d622-4ae8-a3fa-ff5879677b77 service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-18d698e3-a6d2-4573-8131-64461796fa04 req-86db4da4-d622-4ae8-a3fa-ff5879677b77 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] No waiting events found dispatching network-vif-plugged-46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:16 user nova-compute[73068]: WARNING nova.compute.manager [req-18d698e3-a6d2-4573-8131-64461796fa04 req-86db4da4-d622-4ae8-a3fa-ff5879677b77 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received unexpected event network-vif-plugged-46c67a03-2cf3-4345-b194-cb82869cd2ae for instance with vm_state active and task_state None.
Aug 26 11:43:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] No BDM found with device name hda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] No VIF found with MAC fa:16:3e:b1:37:cc, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:43:16 user nova-compute[73068]:   <nova:package version="0.0.0"/>
Aug 26 11:43:16 user nova-compute[73068]:   <nova:name>tempest-device-tagging-server-2100496070</nova:name>
Aug 26 11:43:16 user nova-compute[73068]:   <nova:creationTime>2023-08-26 11:43:16</nova:creationTime>
Aug 26 11:43:16 user nova-compute[73068]:   <nova:flavor name="m1.tiny">
Aug 26 11:43:16 user nova-compute[73068]:     <nova:memory>512</nova:memory>
Aug 26 11:43:16 user nova-compute[73068]:     <nova:disk>1</nova:disk>
Aug 26 11:43:16 user nova-compute[73068]:     <nova:swap>0</nova:swap>
Aug 26 11:43:16 user nova-compute[73068]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:43:16 user nova-compute[73068]:     <nova:vcpus>1</nova:vcpus>
Aug 26 11:43:16 user nova-compute[73068]:   </nova:flavor>
Aug 26 11:43:16 user nova-compute[73068]:   <nova:owner>
Aug 26 11:43:16 user nova-compute[73068]:     <nova:user uuid="3f4f185d03b044309bab5ec41ecefdf0">tempest-TaggedAttachmentsTest-614082727-project-member</nova:user>
Aug 26 11:43:16 user nova-compute[73068]:     <nova:project uuid="e2388755cf904f42b3d230d79ec6872d">tempest-TaggedAttachmentsTest-614082727</nova:project>
Aug 26 11:43:16 user nova-compute[73068]:   </nova:owner>
Aug 26 11:43:16 user nova-compute[73068]:   <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:43:16 user nova-compute[73068]:   <nova:ports>
Aug 26 11:43:16 user nova-compute[73068]:     <nova:port uuid="8d1782f8-3600-4a40-8d7a-c90fa0af9940">
Aug 26 11:43:16 user nova-compute[73068]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 11:43:16 user nova-compute[73068]:     </nova:port>
Aug 26 11:43:16 user nova-compute[73068]:     <nova:port uuid="46c67a03-2cf3-4345-b194-cb82869cd2ae">
Aug 26 11:43:16 user nova-compute[73068]:       <nova:ip type="fixed" address="10.10.10.23" ipVersion="4"/>
Aug 26 11:43:16 user nova-compute[73068]:     </nova:port>
Aug 26 11:43:16 user nova-compute[73068]:   </nova:ports>
Aug 26 11:43:16 user nova-compute[73068]: </nova:instance>
Aug 26 11:43:16 user nova-compute[73068]:  {{(pid=73068) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-eac7c5a3-e45e-4925-9ce4-e87eff394cc4 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "interface-cdb99751-19de-4c5d-a907-c26171588ac8-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.303s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-8c7e98bf-39af-4160-bcf6-04b2bd6978d3 req-3ddea7cc-e8b2-47e1-8859-0362091c5fc9 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updated VIF entry in instance network info cache for port 46c67a03-2cf3-4345-b194-cb82869cd2ae. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-8c7e98bf-39af-4160-bcf6-04b2bd6978d3 req-3ddea7cc-e8b2-47e1-8859-0362091c5fc9 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updating instance_info_cache with network_info: [{"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c7e98bf-39af-4160-bcf6-04b2bd6978d3 req-3ddea7cc-e8b2-47e1-8859-0362091c5fc9 service nova] Releasing lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lazy-loading 'flavor' on Instance uuid cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:17 user nova-compute[73068]: INFO nova.compute.manager [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Attaching volume d1bc1be3-80b4-447c-9c5a-6073479dfac2 to /dev/vdb
Aug 26 11:43:17 user nova-compute[73068]: DEBUG os_brick.utils [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e280b1-9bca-4e2c-b993-faf2cee60ab4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a35551c-46fc-4b06-9cf3-b22185da5be5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad975677-7e67-4b31-8cca-de96e81f7127]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[18568abe-65c3-46ad-85dd-3c2ae8437e84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:43:17 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:43:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3699d5a9-45e9-4a2a-99b1-83cac03f24d7]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG os_brick.utils [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:43:17 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updating existing volume attachment record: 96ccee91-d66b-4845-801e-fcd9be2ecdd7 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:43:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-722585c9-5146-4d48-9b73-19e30759d998 req-f2ee29ad-2542-4553-9084-1a16bc66eb5f service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-vif-plugged-46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-722585c9-5146-4d48-9b73-19e30759d998 req-f2ee29ad-2542-4553-9084-1a16bc66eb5f service nova] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-722585c9-5146-4d48-9b73-19e30759d998 req-f2ee29ad-2542-4553-9084-1a16bc66eb5f service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-722585c9-5146-4d48-9b73-19e30759d998 req-f2ee29ad-2542-4553-9084-1a16bc66eb5f service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-722585c9-5146-4d48-9b73-19e30759d998 req-f2ee29ad-2542-4553-9084-1a16bc66eb5f service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] No waiting events found dispatching network-vif-plugged-46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:18 user nova-compute[73068]: WARNING nova.compute.manager [req-722585c9-5146-4d48-9b73-19e30759d998 req-f2ee29ad-2542-4553-9084-1a16bc66eb5f service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received unexpected event network-vif-plugged-46c67a03-2cf3-4345-b194-cb82869cd2ae for instance with vm_state active and task_state None.
Aug 26 11:43:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:24 user nova-compute[73068]: INFO nova.compute.manager [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Detaching volume 9e986a9e-fe7b-40a5-9e70-d65765ceef6c
Aug 26 11:43:24 user nova-compute[73068]: INFO nova.virt.block_device [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Attempting to driver detach volume 9e986a9e-fe7b-40a5-9e70-d65765ceef6c from mountpoint /dev/vdb
Aug 26 11:43:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Attempting to detach device vdb from instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:43:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:43:24 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:43:24 user nova-compute[73068]:   <source dev="/dev/sdk"/>
Aug 26 11:43:24 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:43:24 user nova-compute[73068]:   <serial>9e986a9e-fe7b-40a5-9e70-d65765ceef6c</serial>
Aug 26 11:43:24 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:43:24 user nova-compute[73068]: </disk>
Aug 26 11:43:24 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:43:24 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Successfully detached device vdb from instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a from the persistent domain config.
Aug 26 11:43:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:43:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:43:24 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:43:24 user nova-compute[73068]:   <source dev="/dev/sdk"/>
Aug 26 11:43:24 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:43:24 user nova-compute[73068]:   <serial>9e986a9e-fe7b-40a5-9e70-d65765ceef6c</serial>
Aug 26 11:43:24 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:43:24 user nova-compute[73068]: </disk>
Aug 26 11:43:24 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050205.0479174, 2e64329a-4cf4-4f10-bbb9-4bb50754841a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:43:25 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Successfully detached device vdb from instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a from the live domain config.
Aug 26 11:43:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fEOmwvYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:43:25 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f12f42-4071-4b79-944c-167e1d56d3a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a6f649-46dd-4c5b-96bc-e0edf58ece02]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:43:25 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c (non-flash)
Aug 26 11:43:25 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb0378820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c'): ({'sdk'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Removing single pathed devices sdk {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f09d2a2-d778-4309-93c7-81c23056dd40]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b348bb7-4dd0-4f81-bbf9-af3b409a45d7]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Flushing IO for device /dev/sdk {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df3f8b4-bf0a-4fcd-8656-e541ae118798]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.054s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d230a6b-7926-4421-851e-e352b636452c]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] SCSI volumes sdk have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb400714-1037-456a-a8b0-364b8ad83197]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[265cf669-086b-4842-b432-98d9c573a61c]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c, portal: 172.16.0.220,3260]
Aug 26 11:43:25 user nova-compute[73068]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c, portal: 172.16.0.220,3260] successful.
Aug 26 11:43:25 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e986a9e-fe7b-40a5-9e70-d65765ceef6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a827837c-ba64-4447-95b5-62acbddae5a3]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] <== disconnect_volume: return (278ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:27 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'flavor' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d377206e-03a0-4127-bb38-25a425e6e111 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.818s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAFQUPOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:43:29 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:43:29 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:43:29 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4371aab3-f6bd-4371-b12c-b09a3ba9f900]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:43:29 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[77912624-6645-4289-9448-2c60904b509f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2] added
Aug 26 11:43:29 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[58826a35-ae10-4412-b82e-b5fb1e8fb893]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[383c6aeb-4f43-4aaf-b4f9-7b2163595c08]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:29 user nova-compute[73068]: INFO nova.compute.manager [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Terminating instance
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG nova.compute.manager [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAFQUPOX {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAFQUPOX" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5acd29-9f67-4ca3-8cbf-e783eb930d20]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oAFQUPOX'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce521299-abe8-4c19-be05-5c3a277b9adf]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[545c6d67-c61c-47f6-87df-2a03fc38a55f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 11:43:29 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 11:43:29 user nova-compute[73068]:  {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:43:29 user nova-compute[73068]: WARNING os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 11:43:29 user nova-compute[73068]: 
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f36085-9b39-439c-80de-ec756460ef2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2, portal: 172.16.0.220,3260]
Aug 26 11:43:29 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2, portal: 172.16.0.220,3260] successful.
Aug 26 11:43:29 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b12a72-5b31-425d-925c-1324ac99c5dc]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb77821-2ec4-4e1c-a4cc-284f362fdc5c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 (non-flash)
Aug 26 11:43:29 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 (non-flash)
Aug 26 11:43:29 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5499e7b6-0919-48b8-9bab-2022ed854d00]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAFQUPOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-059d648a-c206-4f2b-8a5c-65fa61cd6f62 req-c3db4489-5c91-4079-a840-253b3f5c3ebc service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-vif-unplugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-059d648a-c206-4f2b-8a5c-65fa61cd6f62 req-c3db4489-5c91-4079-a840-253b3f5c3ebc service nova] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-059d648a-c206-4f2b-8a5c-65fa61cd6f62 req-c3db4489-5c91-4079-a840-253b3f5c3ebc service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-059d648a-c206-4f2b-8a5c-65fa61cd6f62 req-c3db4489-5c91-4079-a840-253b3f5c3ebc service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-059d648a-c206-4f2b-8a5c-65fa61cd6f62 req-c3db4489-5c91-4079-a840-253b3f5c3ebc service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] No waiting events found dispatching network-vif-unplugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-059d648a-c206-4f2b-8a5c-65fa61cd6f62 req-c3db4489-5c91-4079-a840-253b3f5c3ebc service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-vif-unplugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:29 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Instance destroyed successfully.
Aug 26 11:43:29 user nova-compute[73068]: DEBUG nova.objects.instance [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lazy-loading 'resources' on Instance uuid 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-919236364',display_name='tempest-VolumesAdminNegativeTest-server-919236364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-919236364',id=5,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFeDgv6hB7R1DY6P9QvdzLjYR/X16/bV+NPCbOIcZzOAmocuOchmKrNM/oTHBes6hqGglsU77dapUrIOE5gfBb7O1uXXVTxk3I5I5bJYw7nLPVebWNFOMFeqxVuiVX9RNg==',key_name='tempest-keypair-1051536643',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1112219a9fc34797b1d9f5e872bea350',ramdisk_id='',reservation_id='r-n9bb20yq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-175851604',owner_user_name='tempest-VolumesAdminNegativeTest-175851604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:37:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed086ebc2de14a0f9b55c87a40f5f621',uuid=3bbfbd87-eda4-4835-bdaa-b3fa5daf9741,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "address": "fa:16:3e:7f:de:1f", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01dafe-b0", "ovs_interfaceid": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converting VIF {"id": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "address": "fa:16:3e:7f:de:1f", "network": {"id": "dc8e5f63-b4be-4c3c-8192-25c45e5d0947", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-101348749-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1112219a9fc34797b1d9f5e872bea350", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b01dafe-b0", "ovs_interfaceid": "5b01dafe-b0f5-420a-9c1f-dfc578e12679", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:de:1f,bridge_name='br-int',has_traffic_filtering=True,id=5b01dafe-b0f5-420a-9c1f-dfc578e12679,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01dafe-b0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG os_vif [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:de:1f,bridge_name='br-int',has_traffic_filtering=True,id=5b01dafe-b0f5-420a-9c1f-dfc578e12679,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01dafe-b0') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b01dafe-b0, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:43:30 user nova-compute[73068]: INFO os_vif [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:de:1f,bridge_name='br-int',has_traffic_filtering=True,id=5b01dafe-b0f5-420a-9c1f-dfc578e12679,network=Network(dc8e5f63-b4be-4c3c-8192-25c45e5d0947),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b01dafe-b0')
Aug 26 11:43:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Deleting instance files /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741_del
Aug 26 11:43:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Deletion of /opt/stack/data/nova/instances/3bbfbd87-eda4-4835-bdaa-b3fa5daf9741_del complete
Aug 26 11:43:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:30 user nova-compute[73068]: INFO nova.compute.manager [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 11:43:30 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26135323865323761', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135323865323761', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lazy-loading 'flavor' on Instance uuid cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:43:30 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:43:30 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:43:30 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:43:30 user nova-compute[73068]:   <serial>d1bc1be3-80b4-447c-9c5a-6073479dfac2</serial>
Aug 26 11:43:30 user nova-compute[73068]: </disk>
Aug 26 11:43:30 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] No BDM found with device name hda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:43:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] No VIF found with MAC fa:16:3e:b1:37:cc, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1cdb7463-3492-48de-8500-1f83b7e86939 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.800s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:31 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Took 1.24 seconds to deallocate network for instance.
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-c75c0a40-afcb-48cf-9e73-c4305c9016e5 req-ad2d9c46-8ca5-4178-97ba-b4ba7a4d8d72 service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-vif-deleted-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] No waiting events found dispatching network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:31 user nova-compute[73068]: WARNING nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received unexpected event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 for instance with vm_state deleted and task_state None.
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] No waiting events found dispatching network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:31 user nova-compute[73068]: WARNING nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received unexpected event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 for instance with vm_state deleted and task_state None.
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] No waiting events found dispatching network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:31 user nova-compute[73068]: WARNING nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received unexpected event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 for instance with vm_state deleted and task_state None.
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-vif-unplugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] No waiting events found dispatching network-vif-unplugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:31 user nova-compute[73068]: WARNING nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received unexpected event network-vif-unplugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 for instance with vm_state deleted and task_state None.
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Acquiring lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] No waiting events found dispatching network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:31 user nova-compute[73068]: WARNING nova.compute.manager [req-ae6be7b2-84b3-41d6-af4c-fef0f3d128b8 req-22df022a-9a34-4848-a671-652b20e61a0b service nova] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Received unexpected event network-vif-plugged-5b01dafe-b0f5-420a-9c1f-dfc578e12679 for instance with vm_state deleted and task_state None.
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:31 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Deleted allocations for instance 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741
Aug 26 11:43:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45ca5bb9-31b6-43a8-91a0-9d16370a27b1 tempest-VolumesAdminNegativeTest-175851604 tempest-VolumesAdminNegativeTest-175851604-project-member] Lock "3bbfbd87-eda4-4835-bdaa-b3fa5daf9741" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.738s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:32 user nova-compute[73068]: INFO nova.compute.manager [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Detaching volume d1bc1be3-80b4-447c-9c5a-6073479dfac2
Aug 26 11:43:32 user nova-compute[73068]: INFO nova.virt.block_device [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Attempting to driver detach volume d1bc1be3-80b4-447c-9c5a-6073479dfac2 from mountpoint /dev/vdb
Aug 26 11:43:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Attempting to detach device vdb from instance cdb99751-19de-4c5d-a907-c26171588ac8 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:43:32 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:43:32 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:43:32 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:43:32 user nova-compute[73068]:   <serial>d1bc1be3-80b4-447c-9c5a-6073479dfac2</serial>
Aug 26 11:43:32 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 11:43:32 user nova-compute[73068]: </disk>
Aug 26 11:43:32 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:43:32 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Successfully detached device vdb from instance cdb99751-19de-4c5d-a907-c26171588ac8 from the persistent domain config.
Aug 26 11:43:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cdb99751-19de-4c5d-a907-c26171588ac8 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:43:32 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:43:32 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:43:32 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:43:32 user nova-compute[73068]:   <serial>d1bc1be3-80b4-447c-9c5a-6073479dfac2</serial>
Aug 26 11:43:32 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 11:43:32 user nova-compute[73068]: </disk>
Aug 26 11:43:32 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050212.7755086, cdb99751-19de-4c5d-a907-c26171588ac8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:43:32 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Successfully detached device vdb from instance cdb99751-19de-4c5d-a907-c26171588ac8 from the live domain config.
Aug 26 11:43:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAFQUPOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:43:32 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[138711d1-88f9-4a7d-bb5d-ab46ccd3d643]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0858e356-e644-4f55-9535-c1feda094709]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 (non-flash)
Aug 26 11:43:32 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 (non-flash)
Aug 26 11:43:32 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd90368a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[94133999-ee1f-414c-92df-b6b2a4ad422b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2b2b08-329f-47eb-bb59-77b2b5b74b3a]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4cd677-2db0-4fa8-b2ae-bef7f6e11541]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8605165e-229f-41af-9574-a886a7a66f7c]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fadbac-7bba-4553-ba40-9164f3efd168]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd5d4d4-2a79-4ec1-8c02-80ee080b4258]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2, portal: 172.16.0.220,3260]
Aug 26 11:43:33 user nova-compute[73068]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2, portal: 172.16.0.220,3260] successful.
Aug 26 11:43:33 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1bc1be3-80b4-447c-9c5a-6073479dfac2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e48c40-2d19-45d4-b314-bb59a8c636b7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] <== disconnect_volume: return (279ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:33 user nova-compute[73068]: DEBUG nova.objects.instance [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lazy-loading 'flavor' on Instance uuid cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cbcd5d86-cfac-444e-9233-59c05738a29f tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.801s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "interface-cdb99751-19de-4c5d-a907-c26171588ac8-46c67a03-2cf3-4345-b194-cb82869cd2ae" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "interface-cdb99751-19de-4c5d-a907-c26171588ac8-46c67a03-2cf3-4345-b194-cb82869cd2ae" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lazy-loading 'flavor' on Instance uuid cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2100496070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2100496070',id=16,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKbySJmVWh9UQ7qb3tUFqXAG4F4u73SvfWieL2FnPT9HdG8s0mzeP8XQ+eMqOdGsZsgImfuW6s2qjo030oPbO+cr3zcJ8y7QBNnWq0FqFvKKQfT+n/6uIS6SeAzAbYcrQ==',key_name='tempest-keypair-1068818479',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2388755cf904f42b3d230d79ec6872d',ramdisk_id='',reservation_id='r-ttxk903y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-614082727',owner_user_name='tempest-TaggedAttachmentsTest-614082727-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4f185d03b044309bab5ec41ecefdf0',uuid=cdb99751-19de-4c5d-a907-c26171588ac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converting VIF {"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:73:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap46c67a03-2c"/></interface> {{(pid=73068) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:73:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap46c67a03-2c"/></interface> {{(pid=73068) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Attempting to detach device tap46c67a03-2c from instance cdb99751-19de-4c5d-a907-c26171588ac8 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] detach device xml: <interface type="ethernet">
Aug 26 11:43:34 user nova-compute[73068]:   <mac address="fa:16:3e:e8:73:f9"/>
Aug 26 11:43:34 user nova-compute[73068]:   <model type="virtio"/>
Aug 26 11:43:34 user nova-compute[73068]:   <mtu size="1442"/>
Aug 26 11:43:34 user nova-compute[73068]:   <target dev="tap46c67a03-2c"/>
Aug 26 11:43:34 user nova-compute[73068]: </interface>
Aug 26 11:43:34 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:73:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap46c67a03-2c"/></interface> {{(pid=73068) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e8:73:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap46c67a03-2c"/></interface>not found in domain: <domain type='kvm' id='18'>
Aug 26 11:43:34 user nova-compute[73068]:   <name>instance-00000010</name>
Aug 26 11:43:34 user nova-compute[73068]:   <uuid>cdb99751-19de-4c5d-a907-c26171588ac8</uuid>
Aug 26 11:43:34 user nova-compute[73068]:   <metadata>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:43:34 user nova-compute[73068]:   <nova:package version="0.0.0"/>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:name>tempest-device-tagging-server-2100496070</nova:name>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:creationTime>2023-08-26 11:43:16</nova:creationTime>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:flavor name="m1.tiny">
Aug 26 11:43:34 user nova-compute[73068]:     <nova:memory>512</nova:memory>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:disk>1</nova:disk>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:swap>0</nova:swap>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:vcpus>1</nova:vcpus>
Aug 26 11:43:34 user nova-compute[73068]:   </nova:flavor>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:owner>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:user uuid="3f4f185d03b044309bab5ec41ecefdf0">tempest-TaggedAttachmentsTest-614082727-project-member</nova:user>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:project uuid="e2388755cf904f42b3d230d79ec6872d">tempest-TaggedAttachmentsTest-614082727</nova:project>
Aug 26 11:43:34 user nova-compute[73068]:   </nova:owner>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:ports>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:port uuid="8d1782f8-3600-4a40-8d7a-c90fa0af9940">
Aug 26 11:43:34 user nova-compute[73068]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 11:43:34 user nova-compute[73068]:     </nova:port>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:port uuid="46c67a03-2cf3-4345-b194-cb82869cd2ae">
Aug 26 11:43:34 user nova-compute[73068]:       <nova:ip type="fixed" address="10.10.10.23" ipVersion="4"/>
Aug 26 11:43:34 user nova-compute[73068]:     </nova:port>
Aug 26 11:43:34 user nova-compute[73068]:   </nova:ports>
Aug 26 11:43:34 user nova-compute[73068]: </nova:instance>
Aug 26 11:43:34 user nova-compute[73068]:   </metadata>
Aug 26 11:43:34 user nova-compute[73068]:   <memory unit='KiB'>524288</memory>
Aug 26 11:43:34 user nova-compute[73068]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 11:43:34 user nova-compute[73068]:   <vcpu placement='static'>1</vcpu>
Aug 26 11:43:34 user nova-compute[73068]:   <resource>
Aug 26 11:43:34 user nova-compute[73068]:     <partition>/machine</partition>
Aug 26 11:43:34 user nova-compute[73068]:   </resource>
Aug 26 11:43:34 user nova-compute[73068]:   <sysinfo type='smbios'>
Aug 26 11:43:34 user nova-compute[73068]:     <system>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='version'>0.0.0</entry>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='serial'>cdb99751-19de-4c5d-a907-c26171588ac8</entry>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='uuid'>cdb99751-19de-4c5d-a907-c26171588ac8</entry>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='family'>Virtual Machine</entry>
Aug 26 11:43:34 user nova-compute[73068]:     </system>
Aug 26 11:43:34 user nova-compute[73068]:   </sysinfo>
Aug 26 11:43:34 user nova-compute[73068]:   <os>
Aug 26 11:43:34 user nova-compute[73068]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 11:43:34 user nova-compute[73068]:     <boot dev='hd'/>
Aug 26 11:43:34 user nova-compute[73068]:     <smbios mode='sysinfo'/>
Aug 26 11:43:34 user nova-compute[73068]:   </os>
Aug 26 11:43:34 user nova-compute[73068]:   <features>
Aug 26 11:43:34 user nova-compute[73068]:     <acpi/>
Aug 26 11:43:34 user nova-compute[73068]:     <apic/>
Aug 26 11:43:34 user nova-compute[73068]:     <vmcoreinfo state='on'/>
Aug 26 11:43:34 user nova-compute[73068]:   </features>
Aug 26 11:43:34 user nova-compute[73068]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 11:43:34 user nova-compute[73068]:     <model fallback='forbid'>Nehalem</model>
Aug 26 11:43:34 user nova-compute[73068]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 11:43:34 user nova-compute[73068]:     <feature policy='require' name='vme'/>
Aug 26 11:43:34 user nova-compute[73068]:     <feature policy='require' name='x2apic'/>
Aug 26 11:43:34 user nova-compute[73068]:     <feature policy='require' name='hypervisor'/>
Aug 26 11:43:34 user nova-compute[73068]:   </cpu>
Aug 26 11:43:34 user nova-compute[73068]:   <clock offset='utc'>
Aug 26 11:43:34 user nova-compute[73068]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 11:43:34 user nova-compute[73068]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 11:43:34 user nova-compute[73068]:     <timer name='hpet' present='no'/>
Aug 26 11:43:34 user nova-compute[73068]:   </clock>
Aug 26 11:43:34 user nova-compute[73068]:   <on_poweroff>destroy</on_poweroff>
Aug 26 11:43:34 user nova-compute[73068]:   <on_reboot>restart</on_reboot>
Aug 26 11:43:34 user nova-compute[73068]:   <on_crash>destroy</on_crash>
Aug 26 11:43:34 user nova-compute[73068]:   <devices>
Aug 26 11:43:34 user nova-compute[73068]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 11:43:34 user nova-compute[73068]:     <disk type='file' device='disk'>
Aug 26 11:43:34 user nova-compute[73068]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 11:43:34 user nova-compute[73068]:       <source file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk' index='2'/>
Aug 26 11:43:34 user nova-compute[73068]:       <backingStore type='file' index='3'>
Aug 26 11:43:34 user nova-compute[73068]:         <format type='raw'/>
Aug 26 11:43:34 user nova-compute[73068]:         <source file='/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98'/>
Aug 26 11:43:34 user nova-compute[73068]:         <backingStore/>
Aug 26 11:43:34 user nova-compute[73068]:       </backingStore>
Aug 26 11:43:34 user nova-compute[73068]:       <target dev='vda' bus='virtio'/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='virtio-disk0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </disk>
Aug 26 11:43:34 user nova-compute[73068]:     <disk type='file' device='cdrom'>
Aug 26 11:43:34 user nova-compute[73068]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 11:43:34 user nova-compute[73068]:       <source file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk.config' index='1'/>
Aug 26 11:43:34 user nova-compute[73068]:       <backingStore/>
Aug 26 11:43:34 user nova-compute[73068]:       <target dev='hda' bus='ide'/>
Aug 26 11:43:34 user nova-compute[73068]:       <readonly/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='ide0-0-0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </disk>
Aug 26 11:43:34 user nova-compute[73068]:     <controller type='usb' index='0' model='none'>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='usb'/>
Aug 26 11:43:34 user nova-compute[73068]:     </controller>
Aug 26 11:43:34 user nova-compute[73068]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='pci.0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </controller>
Aug 26 11:43:34 user nova-compute[73068]:     <controller type='ide' index='0'>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='ide'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 11:43:34 user nova-compute[73068]:     </controller>
Aug 26 11:43:34 user nova-compute[73068]:     <interface type='ethernet'>
Aug 26 11:43:34 user nova-compute[73068]:       <mac address='fa:16:3e:b1:37:cc'/>
Aug 26 11:43:34 user nova-compute[73068]:       <target dev='tap8d1782f8-36'/>
Aug 26 11:43:34 user nova-compute[73068]:       <model type='virtio'/>
Aug 26 11:43:34 user nova-compute[73068]:       <mtu size='1442'/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='net0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </interface>
Aug 26 11:43:34 user nova-compute[73068]:     <interface type='ethernet'>
Aug 26 11:43:34 user nova-compute[73068]:       <mac address='fa:16:3e:e8:73:f9'/>
Aug 26 11:43:34 user nova-compute[73068]:       <target dev='tap46c67a03-2c'/>
Aug 26 11:43:34 user nova-compute[73068]:       <model type='virtio'/>
Aug 26 11:43:34 user nova-compute[73068]:       <mtu size='1442'/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='net1'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </interface>
Aug 26 11:43:34 user nova-compute[73068]:     <serial type='pty'>
Aug 26 11:43:34 user nova-compute[73068]:       <source path='/dev/pts/7'/>
Aug 26 11:43:34 user nova-compute[73068]:       <log file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/console.log' append='off'/>
Aug 26 11:43:34 user nova-compute[73068]:       <target type='isa-serial' port='0'>
Aug 26 11:43:34 user nova-compute[73068]:         <model name='isa-serial'/>
Aug 26 11:43:34 user nova-compute[73068]:       </target>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='serial0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </serial>
Aug 26 11:43:34 user nova-compute[73068]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 11:43:34 user nova-compute[73068]:       <source path='/dev/pts/7'/>
Aug 26 11:43:34 user nova-compute[73068]:       <log file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/console.log' append='off'/>
Aug 26 11:43:34 user nova-compute[73068]:       <target type='serial' port='0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='serial0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </console>
Aug 26 11:43:34 user nova-compute[73068]:     <input type='mouse' bus='ps2'>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='input0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </input>
Aug 26 11:43:34 user nova-compute[73068]:     <input type='keyboard' bus='ps2'>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='input1'/>
Aug 26 11:43:34 user nova-compute[73068]:     </input>
Aug 26 11:43:34 user nova-compute[73068]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 11:43:34 user nova-compute[73068]:       <listen type='address' address='0.0.0.0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </graphics>
Aug 26 11:43:34 user nova-compute[73068]:     <audio id='1' type='none'/>
Aug 26 11:43:34 user nova-compute[73068]:     <video>
Aug 26 11:43:34 user nova-compute[73068]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='video0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </video>
Aug 26 11:43:34 user nova-compute[73068]:     <memballoon model='virtio'>
Aug 26 11:43:34 user nova-compute[73068]:       <stats period='10'/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='balloon0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </memballoon>
Aug 26 11:43:34 user nova-compute[73068]:     <rng model='virtio'>
Aug 26 11:43:34 user nova-compute[73068]:       <backend model='random'>/dev/urandom</backend>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='rng0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </rng>
Aug 26 11:43:34 user nova-compute[73068]:   </devices>
Aug 26 11:43:34 user nova-compute[73068]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 11:43:34 user nova-compute[73068]:     <label>libvirt-cdb99751-19de-4c5d-a907-c26171588ac8</label>
Aug 26 11:43:34 user nova-compute[73068]:     <imagelabel>libvirt-cdb99751-19de-4c5d-a907-c26171588ac8</imagelabel>
Aug 26 11:43:34 user nova-compute[73068]:   </seclabel>
Aug 26 11:43:34 user nova-compute[73068]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 11:43:34 user nova-compute[73068]:     <label>+64055:+108</label>
Aug 26 11:43:34 user nova-compute[73068]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 11:43:34 user nova-compute[73068]:   </seclabel>
Aug 26 11:43:34 user nova-compute[73068]: </domain>
Aug 26 11:43:34 user nova-compute[73068]:  {{(pid=73068) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 11:43:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Successfully detached device tap46c67a03-2c from instance cdb99751-19de-4c5d-a907-c26171588ac8 from the persistent domain config.
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] (1/8): Attempting to detach device tap46c67a03-2c with device alias net1 from instance cdb99751-19de-4c5d-a907-c26171588ac8 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] detach device xml: <interface type="ethernet">
Aug 26 11:43:34 user nova-compute[73068]:   <mac address="fa:16:3e:e8:73:f9"/>
Aug 26 11:43:34 user nova-compute[73068]:   <model type="virtio"/>
Aug 26 11:43:34 user nova-compute[73068]:   <mtu size="1442"/>
Aug 26 11:43:34 user nova-compute[73068]:   <target dev="tap46c67a03-2c"/>
Aug 26 11:43:34 user nova-compute[73068]: </interface>
Aug 26 11:43:34 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050214.844086, cdb99751-19de-4c5d-a907-c26171588ac8 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Start waiting for the detach event from libvirt for device tap46c67a03-2c with device alias net1 for instance cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:73:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap46c67a03-2c"/></interface> {{(pid=73068) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e8:73:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap46c67a03-2c"/></interface>not found in domain: <domain type='kvm' id='18'>
Aug 26 11:43:34 user nova-compute[73068]:   <name>instance-00000010</name>
Aug 26 11:43:34 user nova-compute[73068]:   <uuid>cdb99751-19de-4c5d-a907-c26171588ac8</uuid>
Aug 26 11:43:34 user nova-compute[73068]:   <metadata>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:43:34 user nova-compute[73068]:   <nova:package version="0.0.0"/>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:name>tempest-device-tagging-server-2100496070</nova:name>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:creationTime>2023-08-26 11:43:16</nova:creationTime>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:flavor name="m1.tiny">
Aug 26 11:43:34 user nova-compute[73068]:     <nova:memory>512</nova:memory>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:disk>1</nova:disk>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:swap>0</nova:swap>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:vcpus>1</nova:vcpus>
Aug 26 11:43:34 user nova-compute[73068]:   </nova:flavor>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:owner>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:user uuid="3f4f185d03b044309bab5ec41ecefdf0">tempest-TaggedAttachmentsTest-614082727-project-member</nova:user>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:project uuid="e2388755cf904f42b3d230d79ec6872d">tempest-TaggedAttachmentsTest-614082727</nova:project>
Aug 26 11:43:34 user nova-compute[73068]:   </nova:owner>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:ports>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:port uuid="8d1782f8-3600-4a40-8d7a-c90fa0af9940">
Aug 26 11:43:34 user nova-compute[73068]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 11:43:34 user nova-compute[73068]:     </nova:port>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:port uuid="46c67a03-2cf3-4345-b194-cb82869cd2ae">
Aug 26 11:43:34 user nova-compute[73068]:       <nova:ip type="fixed" address="10.10.10.23" ipVersion="4"/>
Aug 26 11:43:34 user nova-compute[73068]:     </nova:port>
Aug 26 11:43:34 user nova-compute[73068]:   </nova:ports>
Aug 26 11:43:34 user nova-compute[73068]: </nova:instance>
Aug 26 11:43:34 user nova-compute[73068]:   </metadata>
Aug 26 11:43:34 user nova-compute[73068]:   <memory unit='KiB'>524288</memory>
Aug 26 11:43:34 user nova-compute[73068]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 11:43:34 user nova-compute[73068]:   <vcpu placement='static'>1</vcpu>
Aug 26 11:43:34 user nova-compute[73068]:   <resource>
Aug 26 11:43:34 user nova-compute[73068]:     <partition>/machine</partition>
Aug 26 11:43:34 user nova-compute[73068]:   </resource>
Aug 26 11:43:34 user nova-compute[73068]:   <sysinfo type='smbios'>
Aug 26 11:43:34 user nova-compute[73068]:     <system>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='version'>0.0.0</entry>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='serial'>cdb99751-19de-4c5d-a907-c26171588ac8</entry>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='uuid'>cdb99751-19de-4c5d-a907-c26171588ac8</entry>
Aug 26 11:43:34 user nova-compute[73068]:       <entry name='family'>Virtual Machine</entry>
Aug 26 11:43:34 user nova-compute[73068]:     </system>
Aug 26 11:43:34 user nova-compute[73068]:   </sysinfo>
Aug 26 11:43:34 user nova-compute[73068]:   <os>
Aug 26 11:43:34 user nova-compute[73068]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 11:43:34 user nova-compute[73068]:     <boot dev='hd'/>
Aug 26 11:43:34 user nova-compute[73068]:     <smbios mode='sysinfo'/>
Aug 26 11:43:34 user nova-compute[73068]:   </os>
Aug 26 11:43:34 user nova-compute[73068]:   <features>
Aug 26 11:43:34 user nova-compute[73068]:     <acpi/>
Aug 26 11:43:34 user nova-compute[73068]:     <apic/>
Aug 26 11:43:34 user nova-compute[73068]:     <vmcoreinfo state='on'/>
Aug 26 11:43:34 user nova-compute[73068]:   </features>
Aug 26 11:43:34 user nova-compute[73068]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 11:43:34 user nova-compute[73068]:     <model fallback='forbid'>Nehalem</model>
Aug 26 11:43:34 user nova-compute[73068]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 11:43:34 user nova-compute[73068]:     <feature policy='require' name='vme'/>
Aug 26 11:43:34 user nova-compute[73068]:     <feature policy='require' name='x2apic'/>
Aug 26 11:43:34 user nova-compute[73068]:     <feature policy='require' name='hypervisor'/>
Aug 26 11:43:34 user nova-compute[73068]:   </cpu>
Aug 26 11:43:34 user nova-compute[73068]:   <clock offset='utc'>
Aug 26 11:43:34 user nova-compute[73068]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 11:43:34 user nova-compute[73068]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 11:43:34 user nova-compute[73068]:     <timer name='hpet' present='no'/>
Aug 26 11:43:34 user nova-compute[73068]:   </clock>
Aug 26 11:43:34 user nova-compute[73068]:   <on_poweroff>destroy</on_poweroff>
Aug 26 11:43:34 user nova-compute[73068]:   <on_reboot>restart</on_reboot>
Aug 26 11:43:34 user nova-compute[73068]:   <on_crash>destroy</on_crash>
Aug 26 11:43:34 user nova-compute[73068]:   <devices>
Aug 26 11:43:34 user nova-compute[73068]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 11:43:34 user nova-compute[73068]:     <disk type='file' device='disk'>
Aug 26 11:43:34 user nova-compute[73068]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 11:43:34 user nova-compute[73068]:       <source file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk' index='2'/>
Aug 26 11:43:34 user nova-compute[73068]:       <backingStore type='file' index='3'>
Aug 26 11:43:34 user nova-compute[73068]:         <format type='raw'/>
Aug 26 11:43:34 user nova-compute[73068]:         <source file='/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98'/>
Aug 26 11:43:34 user nova-compute[73068]:         <backingStore/>
Aug 26 11:43:34 user nova-compute[73068]:       </backingStore>
Aug 26 11:43:34 user nova-compute[73068]:       <target dev='vda' bus='virtio'/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='virtio-disk0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </disk>
Aug 26 11:43:34 user nova-compute[73068]:     <disk type='file' device='cdrom'>
Aug 26 11:43:34 user nova-compute[73068]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 11:43:34 user nova-compute[73068]:       <source file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk.config' index='1'/>
Aug 26 11:43:34 user nova-compute[73068]:       <backingStore/>
Aug 26 11:43:34 user nova-compute[73068]:       <target dev='hda' bus='ide'/>
Aug 26 11:43:34 user nova-compute[73068]:       <readonly/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='ide0-0-0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </disk>
Aug 26 11:43:34 user nova-compute[73068]:     <controller type='usb' index='0' model='none'>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='usb'/>
Aug 26 11:43:34 user nova-compute[73068]:     </controller>
Aug 26 11:43:34 user nova-compute[73068]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='pci.0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </controller>
Aug 26 11:43:34 user nova-compute[73068]:     <controller type='ide' index='0'>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='ide'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 11:43:34 user nova-compute[73068]:     </controller>
Aug 26 11:43:34 user nova-compute[73068]:     <interface type='ethernet'>
Aug 26 11:43:34 user nova-compute[73068]:       <mac address='fa:16:3e:b1:37:cc'/>
Aug 26 11:43:34 user nova-compute[73068]:       <target dev='tap8d1782f8-36'/>
Aug 26 11:43:34 user nova-compute[73068]:       <model type='virtio'/>
Aug 26 11:43:34 user nova-compute[73068]:       <mtu size='1442'/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='net0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </interface>
Aug 26 11:43:34 user nova-compute[73068]:     <serial type='pty'>
Aug 26 11:43:34 user nova-compute[73068]:       <source path='/dev/pts/7'/>
Aug 26 11:43:34 user nova-compute[73068]:       <log file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/console.log' append='off'/>
Aug 26 11:43:34 user nova-compute[73068]:       <target type='isa-serial' port='0'>
Aug 26 11:43:34 user nova-compute[73068]:         <model name='isa-serial'/>
Aug 26 11:43:34 user nova-compute[73068]:       </target>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='serial0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </serial>
Aug 26 11:43:34 user nova-compute[73068]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 11:43:34 user nova-compute[73068]:       <source path='/dev/pts/7'/>
Aug 26 11:43:34 user nova-compute[73068]:       <log file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/console.log' append='off'/>
Aug 26 11:43:34 user nova-compute[73068]:       <target type='serial' port='0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='serial0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </console>
Aug 26 11:43:34 user nova-compute[73068]:     <input type='mouse' bus='ps2'>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='input0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </input>
Aug 26 11:43:34 user nova-compute[73068]:     <input type='keyboard' bus='ps2'>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='input1'/>
Aug 26 11:43:34 user nova-compute[73068]:     </input>
Aug 26 11:43:34 user nova-compute[73068]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 11:43:34 user nova-compute[73068]:       <listen type='address' address='0.0.0.0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </graphics>
Aug 26 11:43:34 user nova-compute[73068]:     <audio id='1' type='none'/>
Aug 26 11:43:34 user nova-compute[73068]:     <video>
Aug 26 11:43:34 user nova-compute[73068]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='video0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </video>
Aug 26 11:43:34 user nova-compute[73068]:     <memballoon model='virtio'>
Aug 26 11:43:34 user nova-compute[73068]:       <stats period='10'/>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='balloon0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </memballoon>
Aug 26 11:43:34 user nova-compute[73068]:     <rng model='virtio'>
Aug 26 11:43:34 user nova-compute[73068]:       <backend model='random'>/dev/urandom</backend>
Aug 26 11:43:34 user nova-compute[73068]:       <alias name='rng0'/>
Aug 26 11:43:34 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 11:43:34 user nova-compute[73068]:     </rng>
Aug 26 11:43:34 user nova-compute[73068]:   </devices>
Aug 26 11:43:34 user nova-compute[73068]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 11:43:34 user nova-compute[73068]:     <label>libvirt-cdb99751-19de-4c5d-a907-c26171588ac8</label>
Aug 26 11:43:34 user nova-compute[73068]:     <imagelabel>libvirt-cdb99751-19de-4c5d-a907-c26171588ac8</imagelabel>
Aug 26 11:43:34 user nova-compute[73068]:   </seclabel>
Aug 26 11:43:34 user nova-compute[73068]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 11:43:34 user nova-compute[73068]:     <label>+64055:+108</label>
Aug 26 11:43:34 user nova-compute[73068]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 11:43:34 user nova-compute[73068]:   </seclabel>
Aug 26 11:43:34 user nova-compute[73068]: </domain>
Aug 26 11:43:34 user nova-compute[73068]:  {{(pid=73068) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 11:43:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Successfully detached device tap46c67a03-2c from instance cdb99751-19de-4c5d-a907-c26171588ac8 from the live domain config.
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2100496070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2100496070',id=16,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKbySJmVWh9UQ7qb3tUFqXAG4F4u73SvfWieL2FnPT9HdG8s0mzeP8XQ+eMqOdGsZsgImfuW6s2qjo030oPbO+cr3zcJ8y7QBNnWq0FqFvKKQfT+n/6uIS6SeAzAbYcrQ==',key_name='tempest-keypair-1068818479',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2388755cf904f42b3d230d79ec6872d',ramdisk_id='',reservation_id='r-ttxk903y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-614082727',owner_user_name='tempest-TaggedAttachmentsTest-614082727-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4f185d03b044309bab5ec41ecefdf0',uuid=cdb99751-19de-4c5d-a907-c26171588ac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converting VIF {"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG os_vif [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46c67a03-2c, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:43:34 user nova-compute[73068]: INFO os_vif [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c')
Aug 26 11:43:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:43:34 user nova-compute[73068]:   <nova:package version="0.0.0"/>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:name>tempest-device-tagging-server-2100496070</nova:name>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:creationTime>2023-08-26 11:43:34</nova:creationTime>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:flavor name="m1.tiny">
Aug 26 11:43:34 user nova-compute[73068]:     <nova:memory>512</nova:memory>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:disk>1</nova:disk>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:swap>0</nova:swap>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:vcpus>1</nova:vcpus>
Aug 26 11:43:34 user nova-compute[73068]:   </nova:flavor>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:owner>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:user uuid="3f4f185d03b044309bab5ec41ecefdf0">tempest-TaggedAttachmentsTest-614082727-project-member</nova:user>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:project uuid="e2388755cf904f42b3d230d79ec6872d">tempest-TaggedAttachmentsTest-614082727</nova:project>
Aug 26 11:43:34 user nova-compute[73068]:   </nova:owner>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:43:34 user nova-compute[73068]:   <nova:ports>
Aug 26 11:43:34 user nova-compute[73068]:     <nova:port uuid="8d1782f8-3600-4a40-8d7a-c90fa0af9940">
Aug 26 11:43:34 user nova-compute[73068]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 11:43:34 user nova-compute[73068]:     </nova:port>
Aug 26 11:43:34 user nova-compute[73068]:   </nova:ports>
Aug 26 11:43:34 user nova-compute[73068]: </nova:instance>
Aug 26 11:43:34 user nova-compute[73068]:  {{(pid=73068) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-aea3aafe-7edd-456f-809d-cc66427b2aa9 req-d176b17c-aeae-4558-bd34-3ed944357edc service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-vif-unplugged-46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aea3aafe-7edd-456f-809d-cc66427b2aa9 req-d176b17c-aeae-4558-bd34-3ed944357edc service nova] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aea3aafe-7edd-456f-809d-cc66427b2aa9 req-d176b17c-aeae-4558-bd34-3ed944357edc service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aea3aafe-7edd-456f-809d-cc66427b2aa9 req-d176b17c-aeae-4558-bd34-3ed944357edc service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-aea3aafe-7edd-456f-809d-cc66427b2aa9 req-d176b17c-aeae-4558-bd34-3ed944357edc service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] No waiting events found dispatching network-vif-unplugged-46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:35 user nova-compute[73068]: WARNING nova.compute.manager [req-aea3aafe-7edd-456f-809d-cc66427b2aa9 req-d176b17c-aeae-4558-bd34-3ed944357edc service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received unexpected event network-vif-unplugged-46c67a03-2cf3-4345-b194-cb82869cd2ae for instance with vm_state active and task_state None.
Aug 26 11:43:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-vif-deleted-46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:35 user nova-compute[73068]: INFO nova.compute.manager [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Neutron deleted interface 46c67a03-2cf3-4345-b194-cb82869cd2ae; detaching it from the instance and deleting it from the info cache
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updating instance_info_cache with network_info: [{"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquired lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.objects.instance [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] Lazy-loading 'system_metadata' on Instance uuid cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.objects.instance [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] Lazy-loading 'flavor' on Instance uuid cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.objects.base [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] Object Instance<cdb99751-19de-4c5d-a907-c26171588ac8> lazy-loaded attributes: system_metadata,flavor {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2100496070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2100496070',id=16,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKbySJmVWh9UQ7qb3tUFqXAG4F4u73SvfWieL2FnPT9HdG8s0mzeP8XQ+eMqOdGsZsgImfuW6s2qjo030oPbO+cr3zcJ8y7QBNnWq0FqFvKKQfT+n/6uIS6SeAzAbYcrQ==',key_name='tempest-keypair-1068818479',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2388755cf904f42b3d230d79ec6872d',ramdisk_id='',reservation_id='r-ttxk903y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-614082727',owner_user_name='tempest-TaggedAttachmentsTest-614082727-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4f185d03b044309bab5ec41ecefdf0',uuid=cdb99751-19de-4c5d-a907-c26171588ac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] Converting VIF {"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:73:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap46c67a03-2c"/></interface> {{(pid=73068) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e8:73:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap46c67a03-2c"/></interface>not found in domain: <domain type='kvm' id='18'>
Aug 26 11:43:35 user nova-compute[73068]:   <name>instance-00000010</name>
Aug 26 11:43:35 user nova-compute[73068]:   <uuid>cdb99751-19de-4c5d-a907-c26171588ac8</uuid>
Aug 26 11:43:35 user nova-compute[73068]:   <metadata>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:43:35 user nova-compute[73068]:   <nova:package version="0.0.0"/>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:name>tempest-device-tagging-server-2100496070</nova:name>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:creationTime>2023-08-26 11:43:34</nova:creationTime>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:flavor name="m1.tiny">
Aug 26 11:43:35 user nova-compute[73068]:     <nova:memory>512</nova:memory>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:disk>1</nova:disk>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:swap>0</nova:swap>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:vcpus>1</nova:vcpus>
Aug 26 11:43:35 user nova-compute[73068]:   </nova:flavor>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:owner>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:user uuid="3f4f185d03b044309bab5ec41ecefdf0">tempest-TaggedAttachmentsTest-614082727-project-member</nova:user>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:project uuid="e2388755cf904f42b3d230d79ec6872d">tempest-TaggedAttachmentsTest-614082727</nova:project>
Aug 26 11:43:35 user nova-compute[73068]:   </nova:owner>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:ports>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:port uuid="8d1782f8-3600-4a40-8d7a-c90fa0af9940">
Aug 26 11:43:35 user nova-compute[73068]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 11:43:35 user nova-compute[73068]:     </nova:port>
Aug 26 11:43:35 user nova-compute[73068]:   </nova:ports>
Aug 26 11:43:35 user nova-compute[73068]: </nova:instance>
Aug 26 11:43:35 user nova-compute[73068]:   </metadata>
Aug 26 11:43:35 user nova-compute[73068]:   <memory unit='KiB'>524288</memory>
Aug 26 11:43:35 user nova-compute[73068]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 11:43:35 user nova-compute[73068]:   <vcpu placement='static'>1</vcpu>
Aug 26 11:43:35 user nova-compute[73068]:   <resource>
Aug 26 11:43:35 user nova-compute[73068]:     <partition>/machine</partition>
Aug 26 11:43:35 user nova-compute[73068]:   </resource>
Aug 26 11:43:35 user nova-compute[73068]:   <sysinfo type='smbios'>
Aug 26 11:43:35 user nova-compute[73068]:     <system>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='version'>0.0.0</entry>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='serial'>cdb99751-19de-4c5d-a907-c26171588ac8</entry>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='uuid'>cdb99751-19de-4c5d-a907-c26171588ac8</entry>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='family'>Virtual Machine</entry>
Aug 26 11:43:35 user nova-compute[73068]:     </system>
Aug 26 11:43:35 user nova-compute[73068]:   </sysinfo>
Aug 26 11:43:35 user nova-compute[73068]:   <os>
Aug 26 11:43:35 user nova-compute[73068]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 11:43:35 user nova-compute[73068]:     <boot dev='hd'/>
Aug 26 11:43:35 user nova-compute[73068]:     <smbios mode='sysinfo'/>
Aug 26 11:43:35 user nova-compute[73068]:   </os>
Aug 26 11:43:35 user nova-compute[73068]:   <features>
Aug 26 11:43:35 user nova-compute[73068]:     <acpi/>
Aug 26 11:43:35 user nova-compute[73068]:     <apic/>
Aug 26 11:43:35 user nova-compute[73068]:     <vmcoreinfo state='on'/>
Aug 26 11:43:35 user nova-compute[73068]:   </features>
Aug 26 11:43:35 user nova-compute[73068]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 11:43:35 user nova-compute[73068]:     <model fallback='forbid'>Nehalem</model>
Aug 26 11:43:35 user nova-compute[73068]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 11:43:35 user nova-compute[73068]:     <feature policy='require' name='vme'/>
Aug 26 11:43:35 user nova-compute[73068]:     <feature policy='require' name='x2apic'/>
Aug 26 11:43:35 user nova-compute[73068]:     <feature policy='require' name='hypervisor'/>
Aug 26 11:43:35 user nova-compute[73068]:   </cpu>
Aug 26 11:43:35 user nova-compute[73068]:   <clock offset='utc'>
Aug 26 11:43:35 user nova-compute[73068]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 11:43:35 user nova-compute[73068]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 11:43:35 user nova-compute[73068]:     <timer name='hpet' present='no'/>
Aug 26 11:43:35 user nova-compute[73068]:   </clock>
Aug 26 11:43:35 user nova-compute[73068]:   <on_poweroff>destroy</on_poweroff>
Aug 26 11:43:35 user nova-compute[73068]:   <on_reboot>restart</on_reboot>
Aug 26 11:43:35 user nova-compute[73068]:   <on_crash>destroy</on_crash>
Aug 26 11:43:35 user nova-compute[73068]:   <devices>
Aug 26 11:43:35 user nova-compute[73068]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 11:43:35 user nova-compute[73068]:     <disk type='file' device='disk'>
Aug 26 11:43:35 user nova-compute[73068]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 11:43:35 user nova-compute[73068]:       <source file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk' index='2'/>
Aug 26 11:43:35 user nova-compute[73068]:       <backingStore type='file' index='3'>
Aug 26 11:43:35 user nova-compute[73068]:         <format type='raw'/>
Aug 26 11:43:35 user nova-compute[73068]:         <source file='/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98'/>
Aug 26 11:43:35 user nova-compute[73068]:         <backingStore/>
Aug 26 11:43:35 user nova-compute[73068]:       </backingStore>
Aug 26 11:43:35 user nova-compute[73068]:       <target dev='vda' bus='virtio'/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='virtio-disk0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </disk>
Aug 26 11:43:35 user nova-compute[73068]:     <disk type='file' device='cdrom'>
Aug 26 11:43:35 user nova-compute[73068]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 11:43:35 user nova-compute[73068]:       <source file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk.config' index='1'/>
Aug 26 11:43:35 user nova-compute[73068]:       <backingStore/>
Aug 26 11:43:35 user nova-compute[73068]:       <target dev='hda' bus='ide'/>
Aug 26 11:43:35 user nova-compute[73068]:       <readonly/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='ide0-0-0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </disk>
Aug 26 11:43:35 user nova-compute[73068]:     <controller type='usb' index='0' model='none'>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='usb'/>
Aug 26 11:43:35 user nova-compute[73068]:     </controller>
Aug 26 11:43:35 user nova-compute[73068]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='pci.0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </controller>
Aug 26 11:43:35 user nova-compute[73068]:     <controller type='ide' index='0'>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='ide'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 11:43:35 user nova-compute[73068]:     </controller>
Aug 26 11:43:35 user nova-compute[73068]:     <interface type='ethernet'>
Aug 26 11:43:35 user nova-compute[73068]:       <mac address='fa:16:3e:b1:37:cc'/>
Aug 26 11:43:35 user nova-compute[73068]:       <target dev='tap8d1782f8-36'/>
Aug 26 11:43:35 user nova-compute[73068]:       <model type='virtio'/>
Aug 26 11:43:35 user nova-compute[73068]:       <mtu size='1442'/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='net0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </interface>
Aug 26 11:43:35 user nova-compute[73068]:     <serial type='pty'>
Aug 26 11:43:35 user nova-compute[73068]:       <source path='/dev/pts/7'/>
Aug 26 11:43:35 user nova-compute[73068]:       <log file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/console.log' append='off'/>
Aug 26 11:43:35 user nova-compute[73068]:       <target type='isa-serial' port='0'>
Aug 26 11:43:35 user nova-compute[73068]:         <model name='isa-serial'/>
Aug 26 11:43:35 user nova-compute[73068]:       </target>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='serial0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </serial>
Aug 26 11:43:35 user nova-compute[73068]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 11:43:35 user nova-compute[73068]:       <source path='/dev/pts/7'/>
Aug 26 11:43:35 user nova-compute[73068]:       <log file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/console.log' append='off'/>
Aug 26 11:43:35 user nova-compute[73068]:       <target type='serial' port='0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='serial0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </console>
Aug 26 11:43:35 user nova-compute[73068]:     <input type='mouse' bus='ps2'>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='input0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </input>
Aug 26 11:43:35 user nova-compute[73068]:     <input type='keyboard' bus='ps2'>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='input1'/>
Aug 26 11:43:35 user nova-compute[73068]:     </input>
Aug 26 11:43:35 user nova-compute[73068]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 11:43:35 user nova-compute[73068]:       <listen type='address' address='0.0.0.0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </graphics>
Aug 26 11:43:35 user nova-compute[73068]:     <audio id='1' type='none'/>
Aug 26 11:43:35 user nova-compute[73068]:     <video>
Aug 26 11:43:35 user nova-compute[73068]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='video0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </video>
Aug 26 11:43:35 user nova-compute[73068]:     <memballoon model='virtio'>
Aug 26 11:43:35 user nova-compute[73068]:       <stats period='10'/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='balloon0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </memballoon>
Aug 26 11:43:35 user nova-compute[73068]:     <rng model='virtio'>
Aug 26 11:43:35 user nova-compute[73068]:       <backend model='random'>/dev/urandom</backend>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='rng0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </rng>
Aug 26 11:43:35 user nova-compute[73068]:   </devices>
Aug 26 11:43:35 user nova-compute[73068]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 11:43:35 user nova-compute[73068]:     <label>libvirt-cdb99751-19de-4c5d-a907-c26171588ac8</label>
Aug 26 11:43:35 user nova-compute[73068]:     <imagelabel>libvirt-cdb99751-19de-4c5d-a907-c26171588ac8</imagelabel>
Aug 26 11:43:35 user nova-compute[73068]:   </seclabel>
Aug 26 11:43:35 user nova-compute[73068]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 11:43:35 user nova-compute[73068]:     <label>+64055:+108</label>
Aug 26 11:43:35 user nova-compute[73068]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 11:43:35 user nova-compute[73068]:   </seclabel>
Aug 26 11:43:35 user nova-compute[73068]: </domain>
Aug 26 11:43:35 user nova-compute[73068]:  {{(pid=73068) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e8:73:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap46c67a03-2c"/></interface> {{(pid=73068) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e8:73:f9"/><model type="virtio"/><mtu size="1442"/><target dev="tap46c67a03-2c"/></interface>not found in domain: <domain type='kvm' id='18'>
Aug 26 11:43:35 user nova-compute[73068]:   <name>instance-00000010</name>
Aug 26 11:43:35 user nova-compute[73068]:   <uuid>cdb99751-19de-4c5d-a907-c26171588ac8</uuid>
Aug 26 11:43:35 user nova-compute[73068]:   <metadata>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:43:35 user nova-compute[73068]:   <nova:package version="0.0.0"/>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:name>tempest-device-tagging-server-2100496070</nova:name>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:creationTime>2023-08-26 11:43:34</nova:creationTime>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:flavor name="m1.tiny">
Aug 26 11:43:35 user nova-compute[73068]:     <nova:memory>512</nova:memory>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:disk>1</nova:disk>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:swap>0</nova:swap>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:vcpus>1</nova:vcpus>
Aug 26 11:43:35 user nova-compute[73068]:   </nova:flavor>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:owner>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:user uuid="3f4f185d03b044309bab5ec41ecefdf0">tempest-TaggedAttachmentsTest-614082727-project-member</nova:user>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:project uuid="e2388755cf904f42b3d230d79ec6872d">tempest-TaggedAttachmentsTest-614082727</nova:project>
Aug 26 11:43:35 user nova-compute[73068]:   </nova:owner>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:ports>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:port uuid="8d1782f8-3600-4a40-8d7a-c90fa0af9940">
Aug 26 11:43:35 user nova-compute[73068]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 11:43:35 user nova-compute[73068]:     </nova:port>
Aug 26 11:43:35 user nova-compute[73068]:   </nova:ports>
Aug 26 11:43:35 user nova-compute[73068]: </nova:instance>
Aug 26 11:43:35 user nova-compute[73068]:   </metadata>
Aug 26 11:43:35 user nova-compute[73068]:   <memory unit='KiB'>524288</memory>
Aug 26 11:43:35 user nova-compute[73068]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 11:43:35 user nova-compute[73068]:   <vcpu placement='static'>1</vcpu>
Aug 26 11:43:35 user nova-compute[73068]:   <resource>
Aug 26 11:43:35 user nova-compute[73068]:     <partition>/machine</partition>
Aug 26 11:43:35 user nova-compute[73068]:   </resource>
Aug 26 11:43:35 user nova-compute[73068]:   <sysinfo type='smbios'>
Aug 26 11:43:35 user nova-compute[73068]:     <system>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='version'>0.0.0</entry>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='serial'>cdb99751-19de-4c5d-a907-c26171588ac8</entry>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='uuid'>cdb99751-19de-4c5d-a907-c26171588ac8</entry>
Aug 26 11:43:35 user nova-compute[73068]:       <entry name='family'>Virtual Machine</entry>
Aug 26 11:43:35 user nova-compute[73068]:     </system>
Aug 26 11:43:35 user nova-compute[73068]:   </sysinfo>
Aug 26 11:43:35 user nova-compute[73068]:   <os>
Aug 26 11:43:35 user nova-compute[73068]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 11:43:35 user nova-compute[73068]:     <boot dev='hd'/>
Aug 26 11:43:35 user nova-compute[73068]:     <smbios mode='sysinfo'/>
Aug 26 11:43:35 user nova-compute[73068]:   </os>
Aug 26 11:43:35 user nova-compute[73068]:   <features>
Aug 26 11:43:35 user nova-compute[73068]:     <acpi/>
Aug 26 11:43:35 user nova-compute[73068]:     <apic/>
Aug 26 11:43:35 user nova-compute[73068]:     <vmcoreinfo state='on'/>
Aug 26 11:43:35 user nova-compute[73068]:   </features>
Aug 26 11:43:35 user nova-compute[73068]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 11:43:35 user nova-compute[73068]:     <model fallback='forbid'>Nehalem</model>
Aug 26 11:43:35 user nova-compute[73068]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 11:43:35 user nova-compute[73068]:     <feature policy='require' name='vme'/>
Aug 26 11:43:35 user nova-compute[73068]:     <feature policy='require' name='x2apic'/>
Aug 26 11:43:35 user nova-compute[73068]:     <feature policy='require' name='hypervisor'/>
Aug 26 11:43:35 user nova-compute[73068]:   </cpu>
Aug 26 11:43:35 user nova-compute[73068]:   <clock offset='utc'>
Aug 26 11:43:35 user nova-compute[73068]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 11:43:35 user nova-compute[73068]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 11:43:35 user nova-compute[73068]:     <timer name='hpet' present='no'/>
Aug 26 11:43:35 user nova-compute[73068]:   </clock>
Aug 26 11:43:35 user nova-compute[73068]:   <on_poweroff>destroy</on_poweroff>
Aug 26 11:43:35 user nova-compute[73068]:   <on_reboot>restart</on_reboot>
Aug 26 11:43:35 user nova-compute[73068]:   <on_crash>destroy</on_crash>
Aug 26 11:43:35 user nova-compute[73068]:   <devices>
Aug 26 11:43:35 user nova-compute[73068]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 11:43:35 user nova-compute[73068]:     <disk type='file' device='disk'>
Aug 26 11:43:35 user nova-compute[73068]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 11:43:35 user nova-compute[73068]:       <source file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk' index='2'/>
Aug 26 11:43:35 user nova-compute[73068]:       <backingStore type='file' index='3'>
Aug 26 11:43:35 user nova-compute[73068]:         <format type='raw'/>
Aug 26 11:43:35 user nova-compute[73068]:         <source file='/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98'/>
Aug 26 11:43:35 user nova-compute[73068]:         <backingStore/>
Aug 26 11:43:35 user nova-compute[73068]:       </backingStore>
Aug 26 11:43:35 user nova-compute[73068]:       <target dev='vda' bus='virtio'/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='virtio-disk0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </disk>
Aug 26 11:43:35 user nova-compute[73068]:     <disk type='file' device='cdrom'>
Aug 26 11:43:35 user nova-compute[73068]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 11:43:35 user nova-compute[73068]:       <source file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk.config' index='1'/>
Aug 26 11:43:35 user nova-compute[73068]:       <backingStore/>
Aug 26 11:43:35 user nova-compute[73068]:       <target dev='hda' bus='ide'/>
Aug 26 11:43:35 user nova-compute[73068]:       <readonly/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='ide0-0-0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </disk>
Aug 26 11:43:35 user nova-compute[73068]:     <controller type='usb' index='0' model='none'>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='usb'/>
Aug 26 11:43:35 user nova-compute[73068]:     </controller>
Aug 26 11:43:35 user nova-compute[73068]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='pci.0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </controller>
Aug 26 11:43:35 user nova-compute[73068]:     <controller type='ide' index='0'>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='ide'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 11:43:35 user nova-compute[73068]:     </controller>
Aug 26 11:43:35 user nova-compute[73068]:     <interface type='ethernet'>
Aug 26 11:43:35 user nova-compute[73068]:       <mac address='fa:16:3e:b1:37:cc'/>
Aug 26 11:43:35 user nova-compute[73068]:       <target dev='tap8d1782f8-36'/>
Aug 26 11:43:35 user nova-compute[73068]:       <model type='virtio'/>
Aug 26 11:43:35 user nova-compute[73068]:       <mtu size='1442'/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='net0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </interface>
Aug 26 11:43:35 user nova-compute[73068]:     <serial type='pty'>
Aug 26 11:43:35 user nova-compute[73068]:       <source path='/dev/pts/7'/>
Aug 26 11:43:35 user nova-compute[73068]:       <log file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/console.log' append='off'/>
Aug 26 11:43:35 user nova-compute[73068]:       <target type='isa-serial' port='0'>
Aug 26 11:43:35 user nova-compute[73068]:         <model name='isa-serial'/>
Aug 26 11:43:35 user nova-compute[73068]:       </target>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='serial0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </serial>
Aug 26 11:43:35 user nova-compute[73068]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 11:43:35 user nova-compute[73068]:       <source path='/dev/pts/7'/>
Aug 26 11:43:35 user nova-compute[73068]:       <log file='/opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/console.log' append='off'/>
Aug 26 11:43:35 user nova-compute[73068]:       <target type='serial' port='0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='serial0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </console>
Aug 26 11:43:35 user nova-compute[73068]:     <input type='mouse' bus='ps2'>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='input0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </input>
Aug 26 11:43:35 user nova-compute[73068]:     <input type='keyboard' bus='ps2'>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='input1'/>
Aug 26 11:43:35 user nova-compute[73068]:     </input>
Aug 26 11:43:35 user nova-compute[73068]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 11:43:35 user nova-compute[73068]:       <listen type='address' address='0.0.0.0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </graphics>
Aug 26 11:43:35 user nova-compute[73068]:     <audio id='1' type='none'/>
Aug 26 11:43:35 user nova-compute[73068]:     <video>
Aug 26 11:43:35 user nova-compute[73068]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='video0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </video>
Aug 26 11:43:35 user nova-compute[73068]:     <memballoon model='virtio'>
Aug 26 11:43:35 user nova-compute[73068]:       <stats period='10'/>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='balloon0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </memballoon>
Aug 26 11:43:35 user nova-compute[73068]:     <rng model='virtio'>
Aug 26 11:43:35 user nova-compute[73068]:       <backend model='random'>/dev/urandom</backend>
Aug 26 11:43:35 user nova-compute[73068]:       <alias name='rng0'/>
Aug 26 11:43:35 user nova-compute[73068]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 11:43:35 user nova-compute[73068]:     </rng>
Aug 26 11:43:35 user nova-compute[73068]:   </devices>
Aug 26 11:43:35 user nova-compute[73068]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 11:43:35 user nova-compute[73068]:     <label>libvirt-cdb99751-19de-4c5d-a907-c26171588ac8</label>
Aug 26 11:43:35 user nova-compute[73068]:     <imagelabel>libvirt-cdb99751-19de-4c5d-a907-c26171588ac8</imagelabel>
Aug 26 11:43:35 user nova-compute[73068]:   </seclabel>
Aug 26 11:43:35 user nova-compute[73068]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 11:43:35 user nova-compute[73068]:     <label>+64055:+108</label>
Aug 26 11:43:35 user nova-compute[73068]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 11:43:35 user nova-compute[73068]:   </seclabel>
Aug 26 11:43:35 user nova-compute[73068]: </domain>
Aug 26 11:43:35 user nova-compute[73068]:  {{(pid=73068) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 11:43:35 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Detaching interface fa:16:3e:e8:73:f9 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap46c67a03-2c' not found.
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2100496070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2100496070',id=16,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKbySJmVWh9UQ7qb3tUFqXAG4F4u73SvfWieL2FnPT9HdG8s0mzeP8XQ+eMqOdGsZsgImfuW6s2qjo030oPbO+cr3zcJ8y7QBNnWq0FqFvKKQfT+n/6uIS6SeAzAbYcrQ==',key_name='tempest-keypair-1068818479',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2388755cf904f42b3d230d79ec6872d',ramdisk_id='',reservation_id='r-ttxk903y',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-614082727',owner_user_name='tempest-TaggedAttachmentsTest-614082727-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4f185d03b044309bab5ec41ecefdf0',uuid=cdb99751-19de-4c5d-a907-c26171588ac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] Converting VIF {"id": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "address": "fa:16:3e:e8:73:f9", "network": {"id": "19376b13-10cd-4744-a675-dcf4e4e0a8e0", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1579879750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c67a03-2c", "ovs_interfaceid": "46c67a03-2cf3-4345-b194-cb82869cd2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG os_vif [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46c67a03-2c, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:43:35 user nova-compute[73068]: INFO os_vif [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:73:f9,bridge_name='br-int',has_traffic_filtering=True,id=46c67a03-2cf3-4345-b194-cb82869cd2ae,network=Network(19376b13-10cd-4744-a675-dcf4e4e0a8e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c67a03-2c')
Aug 26 11:43:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [req-cf5d6c36-0f2b-4dcf-8206-6675367217f8 req-2b60f786-93db-4d35-a148-d341eccc20ab service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:43:35 user nova-compute[73068]:   <nova:package version="0.0.0"/>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:name>tempest-device-tagging-server-2100496070</nova:name>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:creationTime>2023-08-26 11:43:35</nova:creationTime>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:flavor name="m1.tiny">
Aug 26 11:43:35 user nova-compute[73068]:     <nova:memory>512</nova:memory>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:disk>1</nova:disk>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:swap>0</nova:swap>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:vcpus>1</nova:vcpus>
Aug 26 11:43:35 user nova-compute[73068]:   </nova:flavor>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:owner>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:user uuid="3f4f185d03b044309bab5ec41ecefdf0">tempest-TaggedAttachmentsTest-614082727-project-member</nova:user>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:project uuid="e2388755cf904f42b3d230d79ec6872d">tempest-TaggedAttachmentsTest-614082727</nova:project>
Aug 26 11:43:35 user nova-compute[73068]:   </nova:owner>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:43:35 user nova-compute[73068]:   <nova:ports>
Aug 26 11:43:35 user nova-compute[73068]:     <nova:port uuid="8d1782f8-3600-4a40-8d7a-c90fa0af9940">
Aug 26 11:43:35 user nova-compute[73068]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 11:43:35 user nova-compute[73068]:     </nova:port>
Aug 26 11:43:35 user nova-compute[73068]:   </nova:ports>
Aug 26 11:43:35 user nova-compute[73068]: </nova:instance>
Aug 26 11:43:35 user nova-compute[73068]:  {{(pid=73068) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 11:43:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updating instance_info_cache with network_info: [{"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Releasing lock "refresh_cache-cdb99751-19de-4c5d-a907-c26171588ac8" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e6c8031a-4bca-4fd2-a3e7-241d51346377 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "interface-cdb99751-19de-4c5d-a907-c26171588ac8-46c67a03-2cf3-4345-b194-cb82869cd2ae" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.871s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-42ce4946-e2a0-4e00-bed4-5fe8eaa3a407 req-e0e84618-7949-4399-b89a-52b1faa294f1 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-vif-plugged-46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-42ce4946-e2a0-4e00-bed4-5fe8eaa3a407 req-e0e84618-7949-4399-b89a-52b1faa294f1 service nova] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-42ce4946-e2a0-4e00-bed4-5fe8eaa3a407 req-e0e84618-7949-4399-b89a-52b1faa294f1 service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-42ce4946-e2a0-4e00-bed4-5fe8eaa3a407 req-e0e84618-7949-4399-b89a-52b1faa294f1 service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-42ce4946-e2a0-4e00-bed4-5fe8eaa3a407 req-e0e84618-7949-4399-b89a-52b1faa294f1 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] No waiting events found dispatching network-vif-plugged-46c67a03-2cf3-4345-b194-cb82869cd2ae {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:37 user nova-compute[73068]: WARNING nova.compute.manager [req-42ce4946-e2a0-4e00-bed4-5fe8eaa3a407 req-e0e84618-7949-4399-b89a-52b1faa294f1 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received unexpected event network-vif-plugged-46c67a03-2cf3-4345-b194-cb82869cd2ae for instance with vm_state active and task_state None.
Aug 26 11:43:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "79914502-0e07-4b85-abaa-964bc7350f17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:43:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:43:41 user nova-compute[73068]: INFO nova.compute.claims [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Claim successful on node user
Aug 26 11:43:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:41 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:43:41 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:43:42 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:43:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:43:42 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Creating image(s)
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "/opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "/opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "/opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.188s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk 1073741824" returned: 0 in 0.049s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG nova.policy [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '613022b47a2e40ca949864fa83fa2e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f7f84d7714f8d94971cae316c2215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:43:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:43 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Cannot resize image /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:43:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:43:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Ensure instance console log exists: /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:43:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Successfully created port: 1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Successfully updated port: 1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "refresh_cache-79914502-0e07-4b85-abaa-964bc7350f17" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquired lock "refresh_cache-79914502-0e07-4b85-abaa-964bc7350f17" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.compute.manager [req-69e4658a-3ded-4e45-a288-e3e7077cc18c req-ac5ba6b3-1a7d-4808-b074-637edc003722 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Received event network-changed-1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.compute.manager [req-69e4658a-3ded-4e45-a288-e3e7077cc18c req-ac5ba6b3-1a7d-4808-b074-637edc003722 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Refreshing instance network info cache due to event network-changed-1858f5b5-9e7e-45b1-8a55-29dedc5356ae. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-69e4658a-3ded-4e45-a288-e3e7077cc18c req-ac5ba6b3-1a7d-4808-b074-637edc003722 service nova] Acquiring lock "refresh_cache-79914502-0e07-4b85-abaa-964bc7350f17" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Updating instance_info_cache with network_info: [{"id": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "address": "fa:16:3e:7d:00:73", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1858f5b5-9e", "ovs_interfaceid": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Releasing lock "refresh_cache-79914502-0e07-4b85-abaa-964bc7350f17" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Instance network_info: |[{"id": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "address": "fa:16:3e:7d:00:73", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1858f5b5-9e", "ovs_interfaceid": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-69e4658a-3ded-4e45-a288-e3e7077cc18c req-ac5ba6b3-1a7d-4808-b074-637edc003722 service nova] Acquired lock "refresh_cache-79914502-0e07-4b85-abaa-964bc7350f17" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.network.neutron [req-69e4658a-3ded-4e45-a288-e3e7077cc18c req-ac5ba6b3-1a7d-4808-b074-637edc003722 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Refreshing network info cache for port 1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Start _get_guest_xml network_info=[{"id": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "address": "fa:16:3e:7d:00:73", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1858f5b5-9e", "ovs_interfaceid": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:43:44 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:43:44 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1824173188',display_name='tempest-AttachVolumeNegativeTest-server-1824173188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1824173188',id=20,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Fc5QxcgkBNXdfROp+2q88vYmCcvf2TvScvL0giPWgk3H0bUNxopBV8X0SYWGLUcA0OjX2Yu2Ts+mGk3g91celod3gtQbtK7gfyTNykYNXNYn7lJMjgePnTE6oHLaYhw==',key_name='tempest-keypair-1956548108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-pdqhegjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:43:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=79914502-0e07-4b85-abaa-964bc7350f17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "address": "fa:16:3e:7d:00:73", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1858f5b5-9e", "ovs_interfaceid": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "address": "fa:16:3e:7d:00:73", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1858f5b5-9e", "ovs_interfaceid": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:00:73,bridge_name='br-int',has_traffic_filtering=True,id=1858f5b5-9e7e-45b1-8a55-29dedc5356ae,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1858f5b5-9e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'pci_devices' on Instance uuid 79914502-0e07-4b85-abaa-964bc7350f17 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:43:44 user nova-compute[73068]:   <uuid>79914502-0e07-4b85-abaa-964bc7350f17</uuid>
Aug 26 11:43:44 user nova-compute[73068]:   <name>instance-00000014</name>
Aug 26 11:43:44 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:43:44 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:43:44 user nova-compute[73068]:   <metadata>
Aug 26 11:43:44 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:43:44 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:43:44 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1824173188</nova:name>
Aug 26 11:43:44 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:43:44</nova:creationTime>
Aug 26 11:43:44 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:43:44 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:43:44 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:43:44 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:43:44 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:43:44 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:43:44 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:43:44 user nova-compute[73068]:       <nova:owner>
Aug 26 11:43:44 user nova-compute[73068]:         <nova:user uuid="613022b47a2e40ca949864fa83fa2e73">tempest-AttachVolumeNegativeTest-1321002765-project-member</nova:user>
Aug 26 11:43:44 user nova-compute[73068]:         <nova:project uuid="770f7f84d7714f8d94971cae316c2215">tempest-AttachVolumeNegativeTest-1321002765</nova:project>
Aug 26 11:43:44 user nova-compute[73068]:       </nova:owner>
Aug 26 11:43:44 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:43:44 user nova-compute[73068]:       <nova:ports>
Aug 26 11:43:44 user nova-compute[73068]:         <nova:port uuid="1858f5b5-9e7e-45b1-8a55-29dedc5356ae">
Aug 26 11:43:44 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 11:43:44 user nova-compute[73068]:         </nova:port>
Aug 26 11:43:44 user nova-compute[73068]:       </nova:ports>
Aug 26 11:43:44 user nova-compute[73068]:     </nova:instance>
Aug 26 11:43:44 user nova-compute[73068]:   </metadata>
Aug 26 11:43:44 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:43:44 user nova-compute[73068]:     <system>
Aug 26 11:43:44 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:43:44 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:43:44 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:43:44 user nova-compute[73068]:       <entry name="serial">79914502-0e07-4b85-abaa-964bc7350f17</entry>
Aug 26 11:43:44 user nova-compute[73068]:       <entry name="uuid">79914502-0e07-4b85-abaa-964bc7350f17</entry>
Aug 26 11:43:44 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:43:44 user nova-compute[73068]:     </system>
Aug 26 11:43:44 user nova-compute[73068]:   </sysinfo>
Aug 26 11:43:44 user nova-compute[73068]:   <os>
Aug 26 11:43:44 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:43:44 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:43:44 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:43:44 user nova-compute[73068]:   </os>
Aug 26 11:43:44 user nova-compute[73068]:   <features>
Aug 26 11:43:44 user nova-compute[73068]:     <acpi/>
Aug 26 11:43:44 user nova-compute[73068]:     <apic/>
Aug 26 11:43:44 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:43:44 user nova-compute[73068]:   </features>
Aug 26 11:43:44 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:43:44 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:43:44 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:43:44 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:43:44 user nova-compute[73068]:   </clock>
Aug 26 11:43:44 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:43:44 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:43:44 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:43:44 user nova-compute[73068]:   </cpu>
Aug 26 11:43:44 user nova-compute[73068]:   <devices>
Aug 26 11:43:44 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:43:44 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:43:44 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk"/>
Aug 26 11:43:44 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:43:44 user nova-compute[73068]:     </disk>
Aug 26 11:43:44 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:43:44 user nova-compute[73068]:       <mac address="fa:16:3e:7d:00:73"/>
Aug 26 11:43:44 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:43:44 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:43:44 user nova-compute[73068]:       <target dev="tap1858f5b5-9e"/>
Aug 26 11:43:44 user nova-compute[73068]:     </interface>
Aug 26 11:43:44 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:43:44 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/console.log" append="off"/>
Aug 26 11:43:44 user nova-compute[73068]:     </serial>
Aug 26 11:43:44 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:43:44 user nova-compute[73068]:     <video>
Aug 26 11:43:44 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:43:44 user nova-compute[73068]:     </video>
Aug 26 11:43:44 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:43:44 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:43:44 user nova-compute[73068]:     </rng>
Aug 26 11:43:44 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:43:44 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:43:44 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:43:44 user nova-compute[73068]:     </memballoon>
Aug 26 11:43:44 user nova-compute[73068]:   </devices>
Aug 26 11:43:44 user nova-compute[73068]: </domain>
Aug 26 11:43:44 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1824173188',display_name='tempest-AttachVolumeNegativeTest-server-1824173188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1824173188',id=20,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Fc5QxcgkBNXdfROp+2q88vYmCcvf2TvScvL0giPWgk3H0bUNxopBV8X0SYWGLUcA0OjX2Yu2Ts+mGk3g91celod3gtQbtK7gfyTNykYNXNYn7lJMjgePnTE6oHLaYhw==',key_name='tempest-keypair-1956548108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-pdqhegjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:43:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=79914502-0e07-4b85-abaa-964bc7350f17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "address": "fa:16:3e:7d:00:73", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1858f5b5-9e", "ovs_interfaceid": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "address": "fa:16:3e:7d:00:73", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1858f5b5-9e", "ovs_interfaceid": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:00:73,bridge_name='br-int',has_traffic_filtering=True,id=1858f5b5-9e7e-45b1-8a55-29dedc5356ae,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1858f5b5-9e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG os_vif [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:00:73,bridge_name='br-int',has_traffic_filtering=True,id=1858f5b5-9e7e-45b1-8a55-29dedc5356ae,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1858f5b5-9e') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1858f5b5-9e, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1858f5b5-9e, col_values=(('external_ids', {'iface-id': '1858f5b5-9e7e-45b1-8a55-29dedc5356ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:00:73', 'vm-uuid': '79914502-0e07-4b85-abaa-964bc7350f17'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:44 user nova-compute[73068]: INFO os_vif [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:00:73,bridge_name='br-int',has_traffic_filtering=True,id=1858f5b5-9e7e-45b1-8a55-29dedc5356ae,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1858f5b5-9e')
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No VIF found with MAC fa:16:3e:7d:00:73, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050209.9673173, 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:43:44 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] VM Stopped (Lifecycle Event)
Aug 26 11:43:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cd970744-c151-4cc1-9b74-a1d6036b6278 None None] [instance: 3bbfbd87-eda4-4835-bdaa-b3fa5daf9741] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:45 user nova-compute[73068]: DEBUG nova.network.neutron [req-69e4658a-3ded-4e45-a288-e3e7077cc18c req-ac5ba6b3-1a7d-4808-b074-637edc003722 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Updated VIF entry in instance network info cache for port 1858f5b5-9e7e-45b1-8a55-29dedc5356ae. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:43:45 user nova-compute[73068]: DEBUG nova.network.neutron [req-69e4658a-3ded-4e45-a288-e3e7077cc18c req-ac5ba6b3-1a7d-4808-b074-637edc003722 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Updating instance_info_cache with network_info: [{"id": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "address": "fa:16:3e:7d:00:73", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1858f5b5-9e", "ovs_interfaceid": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-69e4658a-3ded-4e45-a288-e3e7077cc18c req-ac5ba6b3-1a7d-4808-b074-637edc003722 service nova] Releasing lock "refresh_cache-79914502-0e07-4b85-abaa-964bc7350f17" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "792b5efb-63fa-4e87-b114-61de6180b2c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "792b5efb-63fa-4e87-b114-61de6180b2c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:46 user nova-compute[73068]: INFO nova.compute.manager [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Terminating instance
Aug 26 11:43:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:47 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Instance destroyed successfully.
Aug 26 11:43:47 user nova-compute[73068]: DEBUG nova.objects.instance [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lazy-loading 'resources' on Instance uuid 792b5efb-63fa-4e87-b114-61de6180b2c6 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:37:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1531375687',display_name='tempest-TestVolumeSwap-server-1531375687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1531375687',id=7,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu8diY0ApGPWRzxdNFNRUfguOIoAEuQYDAfmIrfJT/jzW4+6VpKY/V9lU5GduJzqulVnfUroQueIVc9VvPKU1/dMECRo1faR8e47HJxZdNp4XXEylSe/Vk3yEf9svNsJw==',key_name='tempest-keypair-181362229',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00974a1d61f24b7e89e75608bc052e22',ramdisk_id='',reservation_id='r-225bvv1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1013364761',owner_user_name='tempest-TestVolumeSwap-1013364761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:37:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26bb98b2bb864f9096ccc7729f8d2eb2',uuid=792b5efb-63fa-4e87-b114-61de6180b2c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Converting VIF {"id": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "address": "fa:16:3e:2b:19:db", "network": {"id": "1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1202316569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00974a1d61f24b7e89e75608bc052e22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca6fdf2c-2c", "ovs_interfaceid": "ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:19:db,bridge_name='br-int',has_traffic_filtering=True,id=ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe,network=Network(1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6fdf2c-2c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG os_vif [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:19:db,bridge_name='br-int',has_traffic_filtering=True,id=ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe,network=Network(1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6fdf2c-2c') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca6fdf2c-2c, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:43:47 user nova-compute[73068]: INFO os_vif [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:19:db,bridge_name='br-int',has_traffic_filtering=True,id=ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe,network=Network(1d81a5a3-c120-4433-a0e1-a7f13b4b9a4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca6fdf2c-2c')
Aug 26 11:43:47 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Deleting instance files /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6_del
Aug 26 11:43:47 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Deletion of /opt/stack/data/nova/instances/792b5efb-63fa-4e87-b114-61de6180b2c6_del complete
Aug 26 11:43:47 user nova-compute[73068]: INFO nova.compute.manager [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 26 11:43:47 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:43:47 user nova-compute[73068]: INFO nova.compute.claims [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Claim successful on node user
Aug 26 11:43:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "e1132a5d-535a-4e72-8d03-25ea977f0034" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:43:48 user nova-compute[73068]: INFO nova.compute.claims [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Claim successful on node user
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.network.neutron [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:43:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:43:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Creating image(s)
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "/opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "/opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.policy [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f42e503ca2ad49479def3b68cb51a7b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '152ceb72f1e54291a5aacf0a7403e4f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:43:48 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Took 1.04 seconds to deallocate network for instance.
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-d7617d98-28bf-440c-9545-d5ae783abf33 req-6a74582f-1741-405e-b479-e8bf33b0e6ec service nova] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Received event network-vif-deleted-ca6fdf2c-2c42-44c1-a8a7-61a8ab7207fe {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.235s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050228.6084678, 79914502-0e07-4b85-abaa-964bc7350f17 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:43:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] VM Resumed (Lifecycle Event)
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:43:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Instance spawned successfully.
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050228.6086707, 79914502-0e07-4b85-abaa-964bc7350f17 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:43:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] VM Started (Lifecycle Event)
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:43:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:43:48 user nova-compute[73068]: INFO nova.compute.manager [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Took 6.57 seconds to spawn the instance on the hypervisor.
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.221s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.754s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.386s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.365s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk 1073741824" returned: 0 in 0.061s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:43:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:43:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:43:49 user nova-compute[73068]: INFO nova.compute.manager [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Took 7.56 seconds to build instance.
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.policy [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4680b32bdaef44f1a95e94447a9cf3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dda8fc35fe4c4e95a5ac4cbbb387bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b7efea23-050d-46c9-8280-8968b9303b53 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.692s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.236s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:43:49 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Creating image(s)
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "/opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "/opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.compute.manager [req-9c77225d-75bf-4ee6-aac4-cf63e36c5ab5 req-ad7fc445-8295-461a-ab05-2b179b4af42f service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Received event network-vif-plugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9c77225d-75bf-4ee6-aac4-cf63e36c5ab5 req-ad7fc445-8295-461a-ab05-2b179b4af42f service nova] Acquiring lock "79914502-0e07-4b85-abaa-964bc7350f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9c77225d-75bf-4ee6-aac4-cf63e36c5ab5 req-ad7fc445-8295-461a-ab05-2b179b4af42f service nova] Lock "79914502-0e07-4b85-abaa-964bc7350f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9c77225d-75bf-4ee6-aac4-cf63e36c5ab5 req-ad7fc445-8295-461a-ab05-2b179b4af42f service nova] Lock "79914502-0e07-4b85-abaa-964bc7350f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.compute.manager [req-9c77225d-75bf-4ee6-aac4-cf63e36c5ab5 req-ad7fc445-8295-461a-ab05-2b179b4af42f service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] No waiting events found dispatching network-vif-plugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:49 user nova-compute[73068]: WARNING nova.compute.manager [req-9c77225d-75bf-4ee6-aac4-cf63e36c5ab5 req-ad7fc445-8295-461a-ab05-2b179b4af42f service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Received unexpected event network-vif-plugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae for instance with vm_state active and task_state None.
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Cannot resize image /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Ensure instance console log exists: /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.network.neutron [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Successfully created port: 8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.211s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.234s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.841s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk 1073741824" returned: 0 in 0.060s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:49 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Deleted allocations for instance 792b5efb-63fa-4e87-b114-61de6180b2c6
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8929eb25-df4e-4e16-9c3f-74a65f817109 tempest-TestVolumeSwap-1013364761 tempest-TestVolumeSwap-1013364761-project-member] Lock "792b5efb-63fa-4e87-b114-61de6180b2c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.501s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.203s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:43:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Cannot resize image /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Ensure instance console log exists: /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Successfully created port: eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Successfully updated port: 8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "refresh_cache-5d0fb227-c825-4fe0-afe4-92f351a70f88" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquired lock "refresh_cache-5d0fb227-c825-4fe0-afe4-92f351a70f88" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.compute.manager [req-de2d63ef-9ac1-463c-9e86-d100e4c3a093 req-2a8e6a6b-a8ed-428f-939c-cc8cda3c002e service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Received event network-changed-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.compute.manager [req-de2d63ef-9ac1-463c-9e86-d100e4c3a093 req-2a8e6a6b-a8ed-428f-939c-cc8cda3c002e service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Refreshing instance network info cache due to event network-changed-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de2d63ef-9ac1-463c-9e86-d100e4c3a093 req-2a8e6a6b-a8ed-428f-939c-cc8cda3c002e service nova] Acquiring lock "refresh_cache-5d0fb227-c825-4fe0-afe4-92f351a70f88" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Updating instance_info_cache with network_info: [{"id": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "address": "fa:16:3e:b3:d5:be", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8e3ed4-51", "ovs_interfaceid": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Releasing lock "refresh_cache-5d0fb227-c825-4fe0-afe4-92f351a70f88" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Instance network_info: |[{"id": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "address": "fa:16:3e:b3:d5:be", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8e3ed4-51", "ovs_interfaceid": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de2d63ef-9ac1-463c-9e86-d100e4c3a093 req-2a8e6a6b-a8ed-428f-939c-cc8cda3c002e service nova] Acquired lock "refresh_cache-5d0fb227-c825-4fe0-afe4-92f351a70f88" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.network.neutron [req-de2d63ef-9ac1-463c-9e86-d100e4c3a093 req-2a8e6a6b-a8ed-428f-939c-cc8cda3c002e service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Refreshing network info cache for port 8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Start _get_guest_xml network_info=[{"id": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "address": "fa:16:3e:b3:d5:be", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8e3ed4-51", "ovs_interfaceid": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:50 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:43:50 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:43:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1493654976',display_name='tempest-VolumesSnapshotTestJSON-instance-1493654976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1493654976',id=21,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPxqLhXW92TWX8AU2xbW6UXcq5dmJgvSI2DT6eWHzxjur6NqBKtgf7Sh7mapKhfT1qa1uCBZlUTrvnD4rqHjtd4gA5iAvxgjf4SoCgBcNX2VabASGBzBudQsWwLG9Aedw==',key_name='tempest-keypair-876547754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='152ceb72f1e54291a5aacf0a7403e4f0',ramdisk_id='',reservation_id='r-sj5u9882',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332483418',owner_user_name='tempest-VolumesSnapshotTestJSON-1332483418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f42e503ca2ad49479def3b68cb51a7b3',uuid=5d0fb227-c825-4fe0-afe4-92f351a70f88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "address": "fa:16:3e:b3:d5:be", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8e3ed4-51", "ovs_interfaceid": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converting VIF {"id": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "address": "fa:16:3e:b3:d5:be", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8e3ed4-51", "ovs_interfaceid": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d5:be,bridge_name='br-int',has_traffic_filtering=True,id=8b8e3ed4-51d1-4535-ac62-c0d3a1f30479,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8e3ed4-51') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.objects.instance [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d0fb227-c825-4fe0-afe4-92f351a70f88 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Successfully updated port: eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:43:51 user nova-compute[73068]:   <uuid>5d0fb227-c825-4fe0-afe4-92f351a70f88</uuid>
Aug 26 11:43:51 user nova-compute[73068]:   <name>instance-00000015</name>
Aug 26 11:43:51 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:43:51 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:43:51 user nova-compute[73068]:   <metadata>
Aug 26 11:43:51 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:43:51 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1493654976</nova:name>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:43:50</nova:creationTime>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:43:51 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:43:51 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:owner>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:user uuid="f42e503ca2ad49479def3b68cb51a7b3">tempest-VolumesSnapshotTestJSON-1332483418-project-member</nova:user>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:project uuid="152ceb72f1e54291a5aacf0a7403e4f0">tempest-VolumesSnapshotTestJSON-1332483418</nova:project>
Aug 26 11:43:51 user nova-compute[73068]:       </nova:owner>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:ports>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:port uuid="8b8e3ed4-51d1-4535-ac62-c0d3a1f30479">
Aug 26 11:43:51 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 11:43:51 user nova-compute[73068]:         </nova:port>
Aug 26 11:43:51 user nova-compute[73068]:       </nova:ports>
Aug 26 11:43:51 user nova-compute[73068]:     </nova:instance>
Aug 26 11:43:51 user nova-compute[73068]:   </metadata>
Aug 26 11:43:51 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:43:51 user nova-compute[73068]:     <system>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="serial">5d0fb227-c825-4fe0-afe4-92f351a70f88</entry>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="uuid">5d0fb227-c825-4fe0-afe4-92f351a70f88</entry>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:43:51 user nova-compute[73068]:     </system>
Aug 26 11:43:51 user nova-compute[73068]:   </sysinfo>
Aug 26 11:43:51 user nova-compute[73068]:   <os>
Aug 26 11:43:51 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:43:51 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:43:51 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:43:51 user nova-compute[73068]:   </os>
Aug 26 11:43:51 user nova-compute[73068]:   <features>
Aug 26 11:43:51 user nova-compute[73068]:     <acpi/>
Aug 26 11:43:51 user nova-compute[73068]:     <apic/>
Aug 26 11:43:51 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:43:51 user nova-compute[73068]:   </features>
Aug 26 11:43:51 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:43:51 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:43:51 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:43:51 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:43:51 user nova-compute[73068]:   </clock>
Aug 26 11:43:51 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:43:51 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:43:51 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:43:51 user nova-compute[73068]:   </cpu>
Aug 26 11:43:51 user nova-compute[73068]:   <devices>
Aug 26 11:43:51 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:43:51 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:43:51 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk"/>
Aug 26 11:43:51 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:43:51 user nova-compute[73068]:     </disk>
Aug 26 11:43:51 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:43:51 user nova-compute[73068]:       <mac address="fa:16:3e:b3:d5:be"/>
Aug 26 11:43:51 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:43:51 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:43:51 user nova-compute[73068]:       <target dev="tap8b8e3ed4-51"/>
Aug 26 11:43:51 user nova-compute[73068]:     </interface>
Aug 26 11:43:51 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:43:51 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/console.log" append="off"/>
Aug 26 11:43:51 user nova-compute[73068]:     </serial>
Aug 26 11:43:51 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:43:51 user nova-compute[73068]:     <video>
Aug 26 11:43:51 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:43:51 user nova-compute[73068]:     </video>
Aug 26 11:43:51 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:43:51 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:43:51 user nova-compute[73068]:     </rng>
Aug 26 11:43:51 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:43:51 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:43:51 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:43:51 user nova-compute[73068]:     </memballoon>
Aug 26 11:43:51 user nova-compute[73068]:   </devices>
Aug 26 11:43:51 user nova-compute[73068]: </domain>
Aug 26 11:43:51 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1493654976',display_name='tempest-VolumesSnapshotTestJSON-instance-1493654976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1493654976',id=21,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPxqLhXW92TWX8AU2xbW6UXcq5dmJgvSI2DT6eWHzxjur6NqBKtgf7Sh7mapKhfT1qa1uCBZlUTrvnD4rqHjtd4gA5iAvxgjf4SoCgBcNX2VabASGBzBudQsWwLG9Aedw==',key_name='tempest-keypair-876547754',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='152ceb72f1e54291a5aacf0a7403e4f0',ramdisk_id='',reservation_id='r-sj5u9882',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332483418',owner_user_name='tempest-VolumesSnapshotTestJSON-1332483418-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:43:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f42e503ca2ad49479def3b68cb51a7b3',uuid=5d0fb227-c825-4fe0-afe4-92f351a70f88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "address": "fa:16:3e:b3:d5:be", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8e3ed4-51", "ovs_interfaceid": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converting VIF {"id": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "address": "fa:16:3e:b3:d5:be", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8e3ed4-51", "ovs_interfaceid": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d5:be,bridge_name='br-int',has_traffic_filtering=True,id=8b8e3ed4-51d1-4535-ac62-c0d3a1f30479,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8e3ed4-51') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG os_vif [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d5:be,bridge_name='br-int',has_traffic_filtering=True,id=8b8e3ed4-51d1-4535-ac62-c0d3a1f30479,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8e3ed4-51') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquired lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-ace21805-b0af-4560-8905-d1fe3b286a95 req-2b208ee0-553d-4709-a72a-f27d09649a5c service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received event network-changed-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-ace21805-b0af-4560-8905-d1fe3b286a95 req-2b208ee0-553d-4709-a72a-f27d09649a5c service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Refreshing instance network info cache due to event network-changed-eaf16461-99d5-49ab-8498-476d74edd0bd. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ace21805-b0af-4560-8905-d1fe3b286a95 req-2b208ee0-553d-4709-a72a-f27d09649a5c service nova] Acquiring lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b8e3ed4-51, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b8e3ed4-51, col_values=(('external_ids', {'iface-id': '8b8e3ed4-51d1-4535-ac62-c0d3a1f30479', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:d5:be', 'vm-uuid': '5d0fb227-c825-4fe0-afe4-92f351a70f88'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:51 user nova-compute[73068]: INFO os_vif [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d5:be,bridge_name='br-int',has_traffic_filtering=True,id=8b8e3ed4-51d1-4535-ac62-c0d3a1f30479,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8e3ed4-51')
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] No VIF found with MAC fa:16:3e:b3:d5:be, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-cfa0829c-3067-4b99-87ce-65353f014af0 req-8cc751d3-b64d-4144-b920-f76e29c88bd9 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Received event network-vif-plugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cfa0829c-3067-4b99-87ce-65353f014af0 req-8cc751d3-b64d-4144-b920-f76e29c88bd9 service nova] Acquiring lock "79914502-0e07-4b85-abaa-964bc7350f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cfa0829c-3067-4b99-87ce-65353f014af0 req-8cc751d3-b64d-4144-b920-f76e29c88bd9 service nova] Lock "79914502-0e07-4b85-abaa-964bc7350f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cfa0829c-3067-4b99-87ce-65353f014af0 req-8cc751d3-b64d-4144-b920-f76e29c88bd9 service nova] Lock "79914502-0e07-4b85-abaa-964bc7350f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-cfa0829c-3067-4b99-87ce-65353f014af0 req-8cc751d3-b64d-4144-b920-f76e29c88bd9 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] No waiting events found dispatching network-vif-plugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:51 user nova-compute[73068]: WARNING nova.compute.manager [req-cfa0829c-3067-4b99-87ce-65353f014af0 req-8cc751d3-b64d-4144-b920-f76e29c88bd9 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Received unexpected event network-vif-plugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae for instance with vm_state active and task_state None.
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updating instance_info_cache with network_info: [{"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Releasing lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Instance network_info: |[{"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ace21805-b0af-4560-8905-d1fe3b286a95 req-2b208ee0-553d-4709-a72a-f27d09649a5c service nova] Acquired lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.neutron [req-ace21805-b0af-4560-8905-d1fe3b286a95 req-2b208ee0-553d-4709-a72a-f27d09649a5c service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Refreshing network info cache for port eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Start _get_guest_xml network_info=[{"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:43:51 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:43:51 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-453986594',display_name='tempest-TestStampPattern-server-453986594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-453986594',id=22,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOjIwqwXxhj4vuR2faSe2o8BRRzkGgGBvS9L7RYqQe1LIPQbk27huMlBAllDlAQDoNhcMEO2Wm63f3TZ8pj6Qh31l00NncZ1Xwq8mt78Mf8ZGjfLHAOGzP1lCwxVTzSgw==',key_name='tempest-TestStampPattern-1601462936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83dda8fc35fe4c4e95a5ac4cbbb387bf',ramdisk_id='',reservation_id='r-e682eog0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2020058093',owner_user_name='tempest-TestStampPattern-2020058093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:43:49Z,user_data=None,user_id='4680b32bdaef44f1a95e94447a9cf3ba',uuid=e1132a5d-535a-4e72-8d03-25ea977f0034,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converting VIF {"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:4e:e4,bridge_name='br-int',has_traffic_filtering=True,id=eaf16461-99d5-49ab-8498-476d74edd0bd,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf16461-99') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lazy-loading 'pci_devices' on Instance uuid e1132a5d-535a-4e72-8d03-25ea977f0034 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.neutron [req-de2d63ef-9ac1-463c-9e86-d100e4c3a093 req-2a8e6a6b-a8ed-428f-939c-cc8cda3c002e service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Updated VIF entry in instance network info cache for port 8b8e3ed4-51d1-4535-ac62-c0d3a1f30479. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.neutron [req-de2d63ef-9ac1-463c-9e86-d100e4c3a093 req-2a8e6a6b-a8ed-428f-939c-cc8cda3c002e service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Updating instance_info_cache with network_info: [{"id": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "address": "fa:16:3e:b3:d5:be", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8e3ed4-51", "ovs_interfaceid": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:43:51 user nova-compute[73068]:   <uuid>e1132a5d-535a-4e72-8d03-25ea977f0034</uuid>
Aug 26 11:43:51 user nova-compute[73068]:   <name>instance-00000016</name>
Aug 26 11:43:51 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:43:51 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:43:51 user nova-compute[73068]:   <metadata>
Aug 26 11:43:51 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:43:51 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:name>tempest-TestStampPattern-server-453986594</nova:name>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:43:51</nova:creationTime>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:43:51 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:43:51 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:owner>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:user uuid="4680b32bdaef44f1a95e94447a9cf3ba">tempest-TestStampPattern-2020058093-project-member</nova:user>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:project uuid="83dda8fc35fe4c4e95a5ac4cbbb387bf">tempest-TestStampPattern-2020058093</nova:project>
Aug 26 11:43:51 user nova-compute[73068]:       </nova:owner>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:43:51 user nova-compute[73068]:       <nova:ports>
Aug 26 11:43:51 user nova-compute[73068]:         <nova:port uuid="eaf16461-99d5-49ab-8498-476d74edd0bd">
Aug 26 11:43:51 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 11:43:51 user nova-compute[73068]:         </nova:port>
Aug 26 11:43:51 user nova-compute[73068]:       </nova:ports>
Aug 26 11:43:51 user nova-compute[73068]:     </nova:instance>
Aug 26 11:43:51 user nova-compute[73068]:   </metadata>
Aug 26 11:43:51 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:43:51 user nova-compute[73068]:     <system>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="serial">e1132a5d-535a-4e72-8d03-25ea977f0034</entry>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="uuid">e1132a5d-535a-4e72-8d03-25ea977f0034</entry>
Aug 26 11:43:51 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:43:51 user nova-compute[73068]:     </system>
Aug 26 11:43:51 user nova-compute[73068]:   </sysinfo>
Aug 26 11:43:51 user nova-compute[73068]:   <os>
Aug 26 11:43:51 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:43:51 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:43:51 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:43:51 user nova-compute[73068]:   </os>
Aug 26 11:43:51 user nova-compute[73068]:   <features>
Aug 26 11:43:51 user nova-compute[73068]:     <acpi/>
Aug 26 11:43:51 user nova-compute[73068]:     <apic/>
Aug 26 11:43:51 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:43:51 user nova-compute[73068]:   </features>
Aug 26 11:43:51 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:43:51 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:43:51 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:43:51 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:43:51 user nova-compute[73068]:   </clock>
Aug 26 11:43:51 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:43:51 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:43:51 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:43:51 user nova-compute[73068]:   </cpu>
Aug 26 11:43:51 user nova-compute[73068]:   <devices>
Aug 26 11:43:51 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:43:51 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:43:51 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk"/>
Aug 26 11:43:51 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:43:51 user nova-compute[73068]:     </disk>
Aug 26 11:43:51 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:43:51 user nova-compute[73068]:       <mac address="fa:16:3e:dd:4e:e4"/>
Aug 26 11:43:51 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:43:51 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:43:51 user nova-compute[73068]:       <target dev="tapeaf16461-99"/>
Aug 26 11:43:51 user nova-compute[73068]:     </interface>
Aug 26 11:43:51 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:43:51 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/console.log" append="off"/>
Aug 26 11:43:51 user nova-compute[73068]:     </serial>
Aug 26 11:43:51 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:43:51 user nova-compute[73068]:     <video>
Aug 26 11:43:51 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:43:51 user nova-compute[73068]:     </video>
Aug 26 11:43:51 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:43:51 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:43:51 user nova-compute[73068]:     </rng>
Aug 26 11:43:51 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:43:51 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:43:51 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:43:51 user nova-compute[73068]:     </memballoon>
Aug 26 11:43:51 user nova-compute[73068]:   </devices>
Aug 26 11:43:51 user nova-compute[73068]: </domain>
Aug 26 11:43:51 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-453986594',display_name='tempest-TestStampPattern-server-453986594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-453986594',id=22,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOjIwqwXxhj4vuR2faSe2o8BRRzkGgGBvS9L7RYqQe1LIPQbk27huMlBAllDlAQDoNhcMEO2Wm63f3TZ8pj6Qh31l00NncZ1Xwq8mt78Mf8ZGjfLHAOGzP1lCwxVTzSgw==',key_name='tempest-TestStampPattern-1601462936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83dda8fc35fe4c4e95a5ac4cbbb387bf',ramdisk_id='',reservation_id='r-e682eog0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2020058093',owner_user_name='tempest-TestStampPattern-2020058093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:43:49Z,user_data=None,user_id='4680b32bdaef44f1a95e94447a9cf3ba',uuid=e1132a5d-535a-4e72-8d03-25ea977f0034,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converting VIF {"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:4e:e4,bridge_name='br-int',has_traffic_filtering=True,id=eaf16461-99d5-49ab-8498-476d74edd0bd,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf16461-99') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG os_vif [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:4e:e4,bridge_name='br-int',has_traffic_filtering=True,id=eaf16461-99d5-49ab-8498-476d74edd0bd,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf16461-99') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-de2d63ef-9ac1-463c-9e86-d100e4c3a093 req-2a8e6a6b-a8ed-428f-939c-cc8cda3c002e service nova] Releasing lock "refresh_cache-5d0fb227-c825-4fe0-afe4-92f351a70f88" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaf16461-99, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeaf16461-99, col_values=(('external_ids', {'iface-id': 'eaf16461-99d5-49ab-8498-476d74edd0bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:4e:e4', 'vm-uuid': 'e1132a5d-535a-4e72-8d03-25ea977f0034'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:51 user nova-compute[73068]: INFO os_vif [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:4e:e4,bridge_name='br-int',has_traffic_filtering=True,id=eaf16461-99d5-49ab-8498-476d74edd0bd,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf16461-99')
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] No VIF found with MAC fa:16:3e:dd:4e:e4, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.network.neutron [req-ace21805-b0af-4560-8905-d1fe3b286a95 req-2b208ee0-553d-4709-a72a-f27d09649a5c service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updated VIF entry in instance network info cache for port eaf16461-99d5-49ab-8498-476d74edd0bd. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.network.neutron [req-ace21805-b0af-4560-8905-d1fe3b286a95 req-2b208ee0-553d-4709-a72a-f27d09649a5c service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updating instance_info_cache with network_info: [{"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ace21805-b0af-4560-8905-d1fe3b286a95 req-2b208ee0-553d-4709-a72a-f27d09649a5c service nova] Releasing lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:43:52 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:43:52 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7657MB free_disk=25.567153930664062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance fba812b3-7791-463f-9c86-a51ae7a7457d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance cdb99751-19de-4c5d-a907-c26171588ac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a39507fb-9897-4e5d-8217-390785208d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 0ad0eb14-0b3e-49f8-bc57-4beb441aa305 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 79914502-0e07-4b85-abaa-964bc7350f17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 5d0fb227-c825-4fe0-afe4-92f351a70f88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance e1132a5d-535a-4e72-8d03-25ea977f0034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:43:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-5c3cef49-139d-4ccb-b623-8b279894b8d2 req-34b34c36-0203-4a3d-af01-d3092882eef0 service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Received event network-vif-plugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5c3cef49-139d-4ccb-b623-8b279894b8d2 req-34b34c36-0203-4a3d-af01-d3092882eef0 service nova] Acquiring lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5c3cef49-139d-4ccb-b623-8b279894b8d2 req-34b34c36-0203-4a3d-af01-d3092882eef0 service nova] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5c3cef49-139d-4ccb-b623-8b279894b8d2 req-34b34c36-0203-4a3d-af01-d3092882eef0 service nova] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-5c3cef49-139d-4ccb-b623-8b279894b8d2 req-34b34c36-0203-4a3d-af01-d3092882eef0 service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] No waiting events found dispatching network-vif-plugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:53 user nova-compute[73068]: WARNING nova.compute.manager [req-5c3cef49-139d-4ccb-b623-8b279894b8d2 req-34b34c36-0203-4a3d-af01-d3092882eef0 service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Received unexpected event network-vif-plugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 for instance with vm_state building and task_state spawning.
Aug 26 11:43:53 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Received event network-vif-plugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] Acquiring lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] No waiting events found dispatching network-vif-plugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:55 user nova-compute[73068]: WARNING nova.compute.manager [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Received unexpected event network-vif-plugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 for instance with vm_state building and task_state spawning.
Aug 26 11:43:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received event network-vif-plugged-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] Acquiring lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] No waiting events found dispatching network-vif-plugged-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:55 user nova-compute[73068]: WARNING nova.compute.manager [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received unexpected event network-vif-plugged-eaf16461-99d5-49ab-8498-476d74edd0bd for instance with vm_state building and task_state spawning.
Aug 26 11:43:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received event network-vif-plugged-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] Acquiring lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] No waiting events found dispatching network-vif-plugged-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:43:55 user nova-compute[73068]: WARNING nova.compute.manager [req-0b31193d-53a2-4c77-8c8e-b9bd5c16b660 req-e26d30e8-963d-4a4f-8209-cea578cd8f07 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received unexpected event network-vif-plugged-eaf16461-99d5-49ab-8498-476d74edd0bd for instance with vm_state building and task_state spawning.
Aug 26 11:43:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050236.3984017, e1132a5d-535a-4e72-8d03-25ea977f0034 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] VM Resumed (Lifecycle Event)
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Instance spawned successfully.
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Instance spawned successfully.
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050236.3995755, e1132a5d-535a-4e72-8d03-25ea977f0034 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] VM Started (Lifecycle Event)
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050236.4033139, 5d0fb227-c825-4fe0-afe4-92f351a70f88 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] VM Resumed (Lifecycle Event)
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.compute.manager [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Took 8.20 seconds to spawn the instance on the hypervisor.
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.compute.manager [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Took 7.38 seconds to spawn the instance on the hypervisor.
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050236.4072506, 5d0fb227-c825-4fe0-afe4-92f351a70f88 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] VM Started (Lifecycle Event)
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.compute.manager [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Took 9.02 seconds to build instance.
Aug 26 11:43:56 user nova-compute[73068]: INFO nova.compute.manager [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Took 8.58 seconds to build instance.
Aug 26 11:43:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-139d0852-eb82-4b55-9f34-1c94864d3dd4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.163s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46f1900b-03e7-4dc1-8bfc-43be1d968f04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.712s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:43:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:43:57 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating instance_info_cache with network_info: [{"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-2e64329a-4cf4-4f10-bbb9-4bb50754841a" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:43:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:43:57 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:57 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:57 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:43:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-a0e7d29a-04fe-412a-b20e-5cf59d48de36 req-8b6cb4a1-7fdd-4b2d-8c50-2502cc2be412 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-changed-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:43:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-a0e7d29a-04fe-412a-b20e-5cf59d48de36 req-8b6cb4a1-7fdd-4b2d-8c50-2502cc2be412 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Refreshing instance network info cache due to event network-changed-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:43:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a0e7d29a-04fe-412a-b20e-5cf59d48de36 req-8b6cb4a1-7fdd-4b2d-8c50-2502cc2be412 service nova] Acquiring lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:43:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a0e7d29a-04fe-412a-b20e-5cf59d48de36 req-8b6cb4a1-7fdd-4b2d-8c50-2502cc2be412 service nova] Acquired lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:43:59 user nova-compute[73068]: DEBUG nova.network.neutron [req-a0e7d29a-04fe-412a-b20e-5cf59d48de36 req-8b6cb4a1-7fdd-4b2d-8c50-2502cc2be412 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Refreshing network info cache for port c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:43:59 user nova-compute[73068]: DEBUG nova.network.neutron [req-a0e7d29a-04fe-412a-b20e-5cf59d48de36 req-8b6cb4a1-7fdd-4b2d-8c50-2502cc2be412 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updated VIF entry in instance network info cache for port c0a2f992-3673-45ea-89b4-5f3fa6b65ef6. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:43:59 user nova-compute[73068]: DEBUG nova.network.neutron [req-a0e7d29a-04fe-412a-b20e-5cf59d48de36 req-8b6cb4a1-7fdd-4b2d-8c50-2502cc2be412 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updating instance_info_cache with network_info: [{"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:43:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a0e7d29a-04fe-412a-b20e-5cf59d48de36 req-8b6cb4a1-7fdd-4b2d-8c50-2502cc2be412 service nova] Releasing lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:44:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:02 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050227.2354755, 792b5efb-63fa-4e87-b114-61de6180b2c6 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:44:02 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] VM Stopped (Lifecycle Event)
Aug 26 11:44:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bbeb60e5-0d88-40fa-8f3b-85fd0c8baab3 None None] [instance: 792b5efb-63fa-4e87-b114-61de6180b2c6] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:44:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:05 user nova-compute[73068]: INFO nova.compute.manager [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Shelving
Aug 26 11:44:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:05 user nova-compute[73068]: DEBUG nova.compute.manager [req-7e0e1cee-e546-4c98-bcef-10c9ce9cda4e req-9653ca84-8f8e-48ce-91d1-39cb56d5c773 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-vif-unplugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7e0e1cee-e546-4c98-bcef-10c9ce9cda4e req-9653ca84-8f8e-48ce-91d1-39cb56d5c773 service nova] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7e0e1cee-e546-4c98-bcef-10c9ce9cda4e req-9653ca84-8f8e-48ce-91d1-39cb56d5c773 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7e0e1cee-e546-4c98-bcef-10c9ce9cda4e req-9653ca84-8f8e-48ce-91d1-39cb56d5c773 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:05 user nova-compute[73068]: DEBUG nova.compute.manager [req-7e0e1cee-e546-4c98-bcef-10c9ce9cda4e req-9653ca84-8f8e-48ce-91d1-39cb56d5c773 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] No waiting events found dispatching network-vif-unplugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:44:05 user nova-compute[73068]: WARNING nova.compute.manager [req-7e0e1cee-e546-4c98-bcef-10c9ce9cda4e req-9653ca84-8f8e-48ce-91d1-39cb56d5c773 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received unexpected event network-vif-unplugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 for instance with vm_state active and task_state shelving.
Aug 26 11:44:06 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] Instance destroyed successfully.
Aug 26 11:44:06 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Beginning cold snapshot process
Aug 26 11:44:06 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:44:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk /opt/stack/data/nova/instances/snapshots/tmpp6upkejn/3136bb9ed4694fe79f30515adafab56c {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk /opt/stack/data/nova/instances/snapshots/tmpp6upkejn/3136bb9ed4694fe79f30515adafab56c" returned: 0 in 0.971s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:07 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Snapshot extracted, beginning image upload
Aug 26 11:44:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd92f34e-cb70-4d54-abd1-a043ebbba068 req-4a7608fe-09df-492e-affd-0b710607f39f service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd92f34e-cb70-4d54-abd1-a043ebbba068 req-4a7608fe-09df-492e-affd-0b710607f39f service nova] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd92f34e-cb70-4d54-abd1-a043ebbba068 req-4a7608fe-09df-492e-affd-0b710607f39f service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd92f34e-cb70-4d54-abd1-a043ebbba068 req-4a7608fe-09df-492e-affd-0b710607f39f service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd92f34e-cb70-4d54-abd1-a043ebbba068 req-4a7608fe-09df-492e-affd-0b710607f39f service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] No waiting events found dispatching network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:44:07 user nova-compute[73068]: WARNING nova.compute.manager [req-dd92f34e-cb70-4d54-abd1-a043ebbba068 req-4a7608fe-09df-492e-affd-0b710607f39f service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received unexpected event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 11:44:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Snapshot image upload complete
Aug 26 11:44:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:44:09 user nova-compute[73068]: INFO nova.compute.manager [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Shelve offloading
Aug 26 11:44:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] Instance destroyed successfully.
Aug 26 11:44:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:44:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:44:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquired lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:44:09 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:44:10 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updating instance_info_cache with network_info: [{"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:44:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Releasing lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:44:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:11 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] Instance destroyed successfully.
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'resources' on Instance uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1102777405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1102777405',id=17,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9Gj2bnIjg7444NWeZckpmwe+Wf6W6d1gltaDp/C9XW68jMmoSS2jQz+RS/tFm7h8fYZMoB2wf4HRsIVu8CUTRpQgs2yU6z7rZaUWorfQO4WfxJNnTHhaZ2pwqgBZtyUw==',key_name='tempest-keypair-1963762537',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-uuvfbky6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member',shelved_at='2023-08-26T11:44:09.749213',shelved_host='user',shelved_image_id='293a6ab3-291a-44eb-8bda-2bdbf7347d3c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:44:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=a39507fb-9897-4e5d-8217-390785208d52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG os_vif [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0a2f992-36, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-2bebb6be-0eec-4116-a762-9a35a7bfeaaf req-347b585a-e08e-40c4-8803-cc7768c59b56 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-changed-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-2bebb6be-0eec-4116-a762-9a35a7bfeaaf req-347b585a-e08e-40c4-8803-cc7768c59b56 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Refreshing instance network info cache due to event network-changed-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2bebb6be-0eec-4116-a762-9a35a7bfeaaf req-347b585a-e08e-40c4-8803-cc7768c59b56 service nova] Acquiring lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2bebb6be-0eec-4116-a762-9a35a7bfeaaf req-347b585a-e08e-40c4-8803-cc7768c59b56 service nova] Acquired lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-2bebb6be-0eec-4116-a762-9a35a7bfeaaf req-347b585a-e08e-40c4-8803-cc7768c59b56 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Refreshing network info cache for port c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:44:11 user nova-compute[73068]: INFO os_vif [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36')
Aug 26 11:44:11 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Deleting instance files /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52_del
Aug 26 11:44:11 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Deletion of /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52_del complete
Aug 26 11:44:11 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Deleted allocations for instance a39507fb-9897-4e5d-8217-390785208d52
Aug 26 11:44:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'numa_topology' on Instance uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.objects.base [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Object Instance<a39507fb-9897-4e5d-8217-390785208d52> lazy-loaded attributes: resources,numa_topology {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-2bebb6be-0eec-4116-a762-9a35a7bfeaaf req-347b585a-e08e-40c4-8803-cc7768c59b56 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updated VIF entry in instance network info cache for port c0a2f992-3673-45ea-89b4-5f3fa6b65ef6. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:44:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-2bebb6be-0eec-4116-a762-9a35a7bfeaaf req-347b585a-e08e-40c4-8803-cc7768c59b56 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updating instance_info_cache with network_info: [{"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc0a2f992-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:44:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2bebb6be-0eec-4116-a762-9a35a7bfeaaf req-347b585a-e08e-40c4-8803-cc7768c59b56 service nova] Releasing lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:44:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e38bece2-7f63-4bbb-9999-c0922f4dd6b0 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.692s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:15 user nova-compute[73068]: INFO nova.compute.manager [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Terminating instance
Aug 26 11:44:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:15 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Instance destroyed successfully.
Aug 26 11:44:15 user nova-compute[73068]: DEBUG nova.objects.instance [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lazy-loading 'resources' on Instance uuid 2e64329a-4cf4-4f10-bbb9-4bb50754841a {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:36:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1968770570',display_name='tempest-ServerStableDeviceRescueTest-server-1968770570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1968770570',id=3,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANeDkCIfgF5NbRelSZtGfTmmKZCd893ZRa0qT/kWApiiF8kiY5NBEz60VroBFpV09CP67IhOPrec3jQOQpp9+8YbogTHVaRrAkokZk75Nc8REAUpIeu1QXyqQ4CF4sKWw==',key_name='tempest-keypair-2049648768',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbaaf8bfcebc433d899f65eb01b79426',ramdisk_id='',reservation_id='r-10gfaets',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-5310612',owner_user_name='tempest-ServerStableDeviceRescueTest-5310612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:42:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4b86976b16444b18f8af379585b27f7',uuid=2e64329a-4cf4-4f10-bbb9-4bb50754841a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Converting VIF {"id": "633ed4fe-2630-42c2-b0ff-dba262056dad", "address": "fa:16:3e:f6:f1:f0", "network": {"id": "693a78d0-f114-4b5d-8504-687156dedb18", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-721860523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbaaf8bfcebc433d899f65eb01b79426", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap633ed4fe-26", "ovs_interfaceid": "633ed4fe-2630-42c2-b0ff-dba262056dad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=633ed4fe-2630-42c2-b0ff-dba262056dad,network=Network(693a78d0-f114-4b5d-8504-687156dedb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633ed4fe-26') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG os_vif [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=633ed4fe-2630-42c2-b0ff-dba262056dad,network=Network(693a78d0-f114-4b5d-8504-687156dedb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633ed4fe-26') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap633ed4fe-26, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:44:15 user nova-compute[73068]: INFO os_vif [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:f1:f0,bridge_name='br-int',has_traffic_filtering=True,id=633ed4fe-2630-42c2-b0ff-dba262056dad,network=Network(693a78d0-f114-4b5d-8504-687156dedb18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap633ed4fe-26')
Aug 26 11:44:15 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Deleting instance files /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a_del
Aug 26 11:44:15 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Deletion of /opt/stack/data/nova/instances/2e64329a-4cf4-4f10-bbb9-4bb50754841a_del complete
Aug 26 11:44:15 user nova-compute[73068]: INFO nova.compute.manager [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 11:44:15 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:44:15 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:44:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-898a1218-0819-4bc6-95ab-04427526d9e9 req-878d3380-11b9-4502-9e9c-745888048a91 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-unplugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-898a1218-0819-4bc6-95ab-04427526d9e9 req-878d3380-11b9-4502-9e9c-745888048a91 service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-898a1218-0819-4bc6-95ab-04427526d9e9 req-878d3380-11b9-4502-9e9c-745888048a91 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-898a1218-0819-4bc6-95ab-04427526d9e9 req-878d3380-11b9-4502-9e9c-745888048a91 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-898a1218-0819-4bc6-95ab-04427526d9e9 req-878d3380-11b9-4502-9e9c-745888048a91 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-unplugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:44:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-898a1218-0819-4bc6-95ab-04427526d9e9 req-878d3380-11b9-4502-9e9c-745888048a91 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-unplugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:44:16 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:44:16 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Took 0.86 seconds to deallocate network for instance.
Aug 26 11:44:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-bb93f106-6e39-4470-bc67-4afda0ff21cd req-203b2f56-9020-495b-87be-d3483c71e3bc service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-deleted-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:16 user nova-compute[73068]: INFO nova.compute.manager [req-bb93f106-6e39-4470-bc67-4afda0ff21cd req-203b2f56-9020-495b-87be-d3483c71e3bc service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Neutron deleted interface 633ed4fe-2630-42c2-b0ff-dba262056dad; detaching it from the instance and deleting it from the info cache
Aug 26 11:44:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-bb93f106-6e39-4470-bc67-4afda0ff21cd req-203b2f56-9020-495b-87be-d3483c71e3bc service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:44:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-bb93f106-6e39-4470-bc67-4afda0ff21cd req-203b2f56-9020-495b-87be-d3483c71e3bc service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Detach interface failed, port_id=633ed4fe-2630-42c2-b0ff-dba262056dad, reason: Instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:44:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:17 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:44:17 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:44:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:17 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Deleted allocations for instance 2e64329a-4cf4-4f10-bbb9-4bb50754841a
Aug 26 11:44:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c771abc4-3408-4cb0-9377-760f5c174075 tempest-ServerStableDeviceRescueTest-5310612 tempest-ServerStableDeviceRescueTest-5310612-project-member] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-77ea8d38-9a0e-4710-a5a8-ecce612a4e18 req-6c9ae316-80a5-47ff-a589-12b37f105935 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-77ea8d38-9a0e-4710-a5a8-ecce612a4e18 req-6c9ae316-80a5-47ff-a589-12b37f105935 service nova] Acquiring lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-77ea8d38-9a0e-4710-a5a8-ecce612a4e18 req-6c9ae316-80a5-47ff-a589-12b37f105935 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-77ea8d38-9a0e-4710-a5a8-ecce612a4e18 req-6c9ae316-80a5-47ff-a589-12b37f105935 service nova] Lock "2e64329a-4cf4-4f10-bbb9-4bb50754841a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-77ea8d38-9a0e-4710-a5a8-ecce612a4e18 req-6c9ae316-80a5-47ff-a589-12b37f105935 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] No waiting events found dispatching network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:44:18 user nova-compute[73068]: WARNING nova.compute.manager [req-77ea8d38-9a0e-4710-a5a8-ecce612a4e18 req-6c9ae316-80a5-47ff-a589-12b37f105935 service nova] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Received unexpected event network-vif-plugged-633ed4fe-2630-42c2-b0ff-dba262056dad for instance with vm_state deleted and task_state None.
Aug 26 11:44:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:21 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050246.1179128, a39507fb-9897-4e5d-8217-390785208d52 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:44:21 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] VM Stopped (Lifecycle Event)
Aug 26 11:44:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-08660c54-6e7e-48c5-8787-9c7fbff080df None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:44:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:24 user nova-compute[73068]: INFO nova.compute.manager [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Terminating instance
Aug 26 11:44:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-453a0812-6a25-4fcd-a9d6-22be0da0539f req-28c23bf7-dfbf-4831-91f4-950026e5f090 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Received event network-vif-unplugged-53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-453a0812-6a25-4fcd-a9d6-22be0da0539f req-28c23bf7-dfbf-4831-91f4-950026e5f090 service nova] Acquiring lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-453a0812-6a25-4fcd-a9d6-22be0da0539f req-28c23bf7-dfbf-4831-91f4-950026e5f090 service nova] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-453a0812-6a25-4fcd-a9d6-22be0da0539f req-28c23bf7-dfbf-4831-91f4-950026e5f090 service nova] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-453a0812-6a25-4fcd-a9d6-22be0da0539f req-28c23bf7-dfbf-4831-91f4-950026e5f090 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] No waiting events found dispatching network-vif-unplugged-53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:44:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-453a0812-6a25-4fcd-a9d6-22be0da0539f req-28c23bf7-dfbf-4831-91f4-950026e5f090 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Received event network-vif-unplugged-53e739a4-a092-432f-9a2b-34c901568270 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:44:25 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Instance destroyed successfully.
Aug 26 11:44:25 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lazy-loading 'resources' on Instance uuid 0ad0eb14-0b3e-49f8-bc57-4beb441aa305 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1032391490',display_name='tempest-VolumesActionsTest-instance-1032391490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1032391490',id=18,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:42:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5eb47d0358f4c5b811b316560a66214',ramdisk_id='',reservation_id='r-mfpvri3l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1862177138',owner_user_name='tempest-VolumesActionsTest-1862177138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:42:42Z,user_data=None,user_id='c5ae30c967be457c81a16fdae5b44f18',uuid=0ad0eb14-0b3e-49f8-bc57-4beb441aa305,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53e739a4-a092-432f-9a2b-34c901568270", "address": "fa:16:3e:a3:d0:46", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e739a4-a0", "ovs_interfaceid": "53e739a4-a092-432f-9a2b-34c901568270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converting VIF {"id": "53e739a4-a092-432f-9a2b-34c901568270", "address": "fa:16:3e:a3:d0:46", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e739a4-a0", "ovs_interfaceid": "53e739a4-a092-432f-9a2b-34c901568270", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d0:46,bridge_name='br-int',has_traffic_filtering=True,id=53e739a4-a092-432f-9a2b-34c901568270,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e739a4-a0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG os_vif [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d0:46,bridge_name='br-int',has_traffic_filtering=True,id=53e739a4-a092-432f-9a2b-34c901568270,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e739a4-a0') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53e739a4-a0, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:25 user nova-compute[73068]: INFO os_vif [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d0:46,bridge_name='br-int',has_traffic_filtering=True,id=53e739a4-a092-432f-9a2b-34c901568270,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53e739a4-a0')
Aug 26 11:44:25 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Deleting instance files /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305_del
Aug 26 11:44:25 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Deletion of /opt/stack/data/nova/instances/0ad0eb14-0b3e-49f8-bc57-4beb441aa305_del complete
Aug 26 11:44:25 user nova-compute[73068]: INFO nova.compute.manager [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 26 11:44:25 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:25 user nova-compute[73068]: INFO nova.compute.manager [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Terminating instance
Aug 26 11:44:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG nova.compute.manager [req-8db1d0c5-7fad-4a2e-83f9-57b959e68e5e req-79f56c4e-8d94-4e5b-a4b2-9c2fb2f94f50 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Received event network-vif-deleted-53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:25 user nova-compute[73068]: INFO nova.compute.manager [req-8db1d0c5-7fad-4a2e-83f9-57b959e68e5e req-79f56c4e-8d94-4e5b-a4b2-9c2fb2f94f50 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Neutron deleted interface 53e739a4-a092-432f-9a2b-34c901568270; detaching it from the instance and deleting it from the info cache
Aug 26 11:44:25 user nova-compute[73068]: DEBUG nova.network.neutron [req-8db1d0c5-7fad-4a2e-83f9-57b959e68e5e req-79f56c4e-8d94-4e5b-a4b2-9c2fb2f94f50 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:44:25 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Took 0.67 seconds to deallocate network for instance.
Aug 26 11:44:25 user nova-compute[73068]: DEBUG nova.compute.manager [req-8db1d0c5-7fad-4a2e-83f9-57b959e68e5e req-79f56c4e-8d94-4e5b-a4b2-9c2fb2f94f50 service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Detach interface failed, port_id=53e739a4-a092-432f-9a2b-34c901568270, reason: Instance 0ad0eb14-0b3e-49f8-bc57-4beb441aa305 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-0c592d8a-799d-476d-8df7-335dfa812230 req-086db735-7a1c-4690-90c0-736170d39f58 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-vif-unplugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0c592d8a-799d-476d-8df7-335dfa812230 req-086db735-7a1c-4690-90c0-736170d39f58 service nova] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0c592d8a-799d-476d-8df7-335dfa812230 req-086db735-7a1c-4690-90c0-736170d39f58 service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0c592d8a-799d-476d-8df7-335dfa812230 req-086db735-7a1c-4690-90c0-736170d39f58 service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-0c592d8a-799d-476d-8df7-335dfa812230 req-086db735-7a1c-4690-90c0-736170d39f58 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] No waiting events found dispatching network-vif-unplugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-0c592d8a-799d-476d-8df7-335dfa812230 req-086db735-7a1c-4690-90c0-736170d39f58 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-vif-unplugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:44:26 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Instance destroyed successfully.
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.objects.instance [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lazy-loading 'resources' on Instance uuid cdb99751-19de-4c5d-a907-c26171588ac8 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T11:41:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2100496070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2100496070',id=16,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKbySJmVWh9UQ7qb3tUFqXAG4F4u73SvfWieL2FnPT9HdG8s0mzeP8XQ+eMqOdGsZsgImfuW6s2qjo030oPbO+cr3zcJ8y7QBNnWq0FqFvKKQfT+n/6uIS6SeAzAbYcrQ==',key_name='tempest-keypair-1068818479',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:41:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2388755cf904f42b3d230d79ec6872d',ramdisk_id='',reservation_id='r-ttxk903y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-614082727',owner_user_name='tempest-TaggedAttachmentsTest-614082727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f4f185d03b044309bab5ec41ecefdf0',uuid=cdb99751-19de-4c5d-a907-c26171588ac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converting VIF {"id": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "address": "fa:16:3e:b1:37:cc", "network": {"id": "07df5834-2979-480c-b8d1-950c912e6f05", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1211259046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2388755cf904f42b3d230d79ec6872d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d1782f8-36", "ovs_interfaceid": "8d1782f8-3600-4a40-8d7a-c90fa0af9940", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=8d1782f8-3600-4a40-8d7a-c90fa0af9940,network=Network(07df5834-2979-480c-b8d1-950c912e6f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d1782f8-36') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG os_vif [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=8d1782f8-3600-4a40-8d7a-c90fa0af9940,network=Network(07df5834-2979-480c-b8d1-950c912e6f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d1782f8-36') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d1782f8-36, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:44:26 user nova-compute[73068]: INFO os_vif [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:37:cc,bridge_name='br-int',has_traffic_filtering=True,id=8d1782f8-3600-4a40-8d7a-c90fa0af9940,network=Network(07df5834-2979-480c-b8d1-950c912e6f05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d1782f8-36')
Aug 26 11:44:26 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Deleting instance files /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8_del
Aug 26 11:44:26 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Deletion of /opt/stack/data/nova/instances/cdb99751-19de-4c5d-a907-c26171588ac8_del complete
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:26 user nova-compute[73068]: INFO nova.compute.manager [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 11:44:26 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:44:26 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Deleted allocations for instance 0ad0eb14-0b3e-49f8-bc57-4beb441aa305
Aug 26 11:44:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1facf191-0d47-4020-9eee-4223677e69d5 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.167s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-36402406-1183-45ac-b2c5-c1b59fe9bead req-fa919cf9-8fee-483c-838a-6e05154e382d service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Received event network-vif-plugged-53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-36402406-1183-45ac-b2c5-c1b59fe9bead req-fa919cf9-8fee-483c-838a-6e05154e382d service nova] Acquiring lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-36402406-1183-45ac-b2c5-c1b59fe9bead req-fa919cf9-8fee-483c-838a-6e05154e382d service nova] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-36402406-1183-45ac-b2c5-c1b59fe9bead req-fa919cf9-8fee-483c-838a-6e05154e382d service nova] Lock "0ad0eb14-0b3e-49f8-bc57-4beb441aa305-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-36402406-1183-45ac-b2c5-c1b59fe9bead req-fa919cf9-8fee-483c-838a-6e05154e382d service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] No waiting events found dispatching network-vif-plugged-53e739a4-a092-432f-9a2b-34c901568270 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:44:26 user nova-compute[73068]: WARNING nova.compute.manager [req-36402406-1183-45ac-b2c5-c1b59fe9bead req-fa919cf9-8fee-483c-838a-6e05154e382d service nova] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Received unexpected event network-vif-plugged-53e739a4-a092-432f-9a2b-34c901568270 for instance with vm_state deleted and task_state None.
Aug 26 11:44:27 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:44:27 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Took 1.04 seconds to deallocate network for instance.
Aug 26 11:44:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:27 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:44:27 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:44:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:27 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Deleted allocations for instance cdb99751-19de-4c5d-a907-c26171588ac8
Aug 26 11:44:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-83bad6d1-dc10-401e-8faf-f0c89bd4e6e1 req-26c94710-a7c6-4aa2-bf1d-6d8b6da01e87 service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-vif-deleted-8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-12cb8841-c783-4716-9106-e08017b074b9 tempest-TaggedAttachmentsTest-614082727 tempest-TaggedAttachmentsTest-614082727-project-member] Lock "cdb99751-19de-4c5d-a907-c26171588ac8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.604s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-673cbec8-b27a-4b35-881b-7e2ddb96d6a7 req-36ea183c-d9d2-4e8c-9253-608b0093c5ff service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received event network-vif-plugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-673cbec8-b27a-4b35-881b-7e2ddb96d6a7 req-36ea183c-d9d2-4e8c-9253-608b0093c5ff service nova] Acquiring lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-673cbec8-b27a-4b35-881b-7e2ddb96d6a7 req-36ea183c-d9d2-4e8c-9253-608b0093c5ff service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-673cbec8-b27a-4b35-881b-7e2ddb96d6a7 req-36ea183c-d9d2-4e8c-9253-608b0093c5ff service nova] Lock "cdb99751-19de-4c5d-a907-c26171588ac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-673cbec8-b27a-4b35-881b-7e2ddb96d6a7 req-36ea183c-d9d2-4e8c-9253-608b0093c5ff service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] No waiting events found dispatching network-vif-plugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:44:28 user nova-compute[73068]: WARNING nova.compute.manager [req-673cbec8-b27a-4b35-881b-7e2ddb96d6a7 req-36ea183c-d9d2-4e8c-9253-608b0093c5ff service nova] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Received unexpected event network-vif-plugged-8d1782f8-3600-4a40-8d7a-c90fa0af9940 for instance with vm_state deleted and task_state None.
Aug 26 11:44:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:30 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050255.8737242, 2e64329a-4cf4-4f10-bbb9-4bb50754841a => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:44:30 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] VM Stopped (Lifecycle Event)
Aug 26 11:44:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a8e90917-216d-4993-8f4e-28514eae6e6a None None] [instance: 2e64329a-4cf4-4f10-bbb9-4bb50754841a] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:44:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:40 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050265.0340178, 0ad0eb14-0b3e-49f8-bc57-4beb441aa305 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:44:40 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] VM Stopped (Lifecycle Event)
Aug 26 11:44:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cc5f33c1-807f-4593-9371-a1b8bae0f023 None None] [instance: 0ad0eb14-0b3e-49f8-bc57-4beb441aa305] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:44:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:41 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050266.1353867, cdb99751-19de-4c5d-a907-c26171588ac8 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:44:41 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] VM Stopped (Lifecycle Event)
Aug 26 11:44:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ce582722-dc5d-4fc4-b20b-7bb0f9ede0d9 None None] [instance: cdb99751-19de-4c5d-a907-c26171588ac8] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:44:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-b767de3b-1618-4d2d-bbeb-debc3496effa req-2cbe54e4-14a8-475d-8586-7b46823708d1 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received event network-changed-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-b767de3b-1618-4d2d-bbeb-debc3496effa req-2cbe54e4-14a8-475d-8586-7b46823708d1 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Refreshing instance network info cache due to event network-changed-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:44:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b767de3b-1618-4d2d-bbeb-debc3496effa req-2cbe54e4-14a8-475d-8586-7b46823708d1 service nova] Acquiring lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:44:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b767de3b-1618-4d2d-bbeb-debc3496effa req-2cbe54e4-14a8-475d-8586-7b46823708d1 service nova] Acquired lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:44:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-b767de3b-1618-4d2d-bbeb-debc3496effa req-2cbe54e4-14a8-475d-8586-7b46823708d1 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Refreshing network info cache for port f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG nova.network.neutron [req-b767de3b-1618-4d2d-bbeb-debc3496effa req-2cbe54e4-14a8-475d-8586-7b46823708d1 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updated VIF entry in instance network info cache for port f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG nova.network.neutron [req-b767de3b-1618-4d2d-bbeb-debc3496effa req-2cbe54e4-14a8-475d-8586-7b46823708d1 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updating instance_info_cache with network_info: [{"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b767de3b-1618-4d2d-bbeb-debc3496effa req-2cbe54e4-14a8-475d-8586-7b46823708d1 service nova] Releasing lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquiring lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:44:42 user nova-compute[73068]: INFO nova.compute.claims [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Claim successful on node user
Aug 26 11:44:42 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:44:42 user nova-compute[73068]: DEBUG nova.network.neutron [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:44:42 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:44:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG nova.policy [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aebb7fd9efa24a4badc4781d49254b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '153275ec93514f4bae4e4df5896c1768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:44:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Creating image(s)
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "/opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "/opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk 1073741824" returned: 0 in 0.048s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Successfully created port: a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Cannot resize image /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Ensure instance console log exists: /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Successfully updated port: a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:44:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquiring lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:44:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquired lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:44:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:44:44 user nova-compute[73068]: DEBUG nova.compute.manager [req-c44dd5e4-1f65-4b63-ae73-9f5bcd198374 req-d59c8e8a-858c-4abe-8c5b-c7602f5007d6 service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Received event network-changed-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:44 user nova-compute[73068]: DEBUG nova.compute.manager [req-c44dd5e4-1f65-4b63-ae73-9f5bcd198374 req-d59c8e8a-858c-4abe-8c5b-c7602f5007d6 service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Refreshing instance network info cache due to event network-changed-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:44:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c44dd5e4-1f65-4b63-ae73-9f5bcd198374 req-d59c8e8a-858c-4abe-8c5b-c7602f5007d6 service nova] Acquiring lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:44:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.network.neutron [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Updating instance_info_cache with network_info: [{"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Releasing lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Instance network_info: |[{"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c44dd5e4-1f65-4b63-ae73-9f5bcd198374 req-d59c8e8a-858c-4abe-8c5b-c7602f5007d6 service nova] Acquired lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.network.neutron [req-c44dd5e4-1f65-4b63-ae73-9f5bcd198374 req-d59c8e8a-858c-4abe-8c5b-c7602f5007d6 service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Refreshing network info cache for port a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Start _get_guest_xml network_info=[{"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:44:45 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:44:45 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1206337114',display_name='tempest-ServerActionsTestOtherB-server-1206337114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1206337114',id=23,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFFxO6g28QnEbPVE9eEWN0xxRXJgko1+norortx0+AlfxJbRvBixXIiMb9HAbuSn6UiypXtchzFrG536bQs1YJPVnBRpPK7Gwtx3Hj+XNlG77aJy0AGfgoQcsN3bXpOiw==',key_name='tempest-keypair-1079791633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='153275ec93514f4bae4e4df5896c1768',ramdisk_id='',reservation_id='r-a081kf7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1424792909',owner_user_name='tempest-ServerActionsTestOtherB-1424792909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aebb7fd9efa24a4badc4781d49254b54',uuid=ffe8d8fe-cc8f-44ab-8b95-5db1772b724d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Converting VIF {"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:29:4c,bridge_name='br-int',has_traffic_filtering=True,id=a6b9bfc5-4a72-4001-83b8-a2f9d4f83415,network=Network(3d6ae9c3-5642-425d-8845-0da423568a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b9bfc5-4a') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.objects.instance [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lazy-loading 'pci_devices' on Instance uuid ffe8d8fe-cc8f-44ab-8b95-5db1772b724d {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:44:45 user nova-compute[73068]:   <uuid>ffe8d8fe-cc8f-44ab-8b95-5db1772b724d</uuid>
Aug 26 11:44:45 user nova-compute[73068]:   <name>instance-00000017</name>
Aug 26 11:44:45 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:44:45 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:44:45 user nova-compute[73068]:   <metadata>
Aug 26 11:44:45 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:44:45 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:44:45 user nova-compute[73068]:       <nova:name>tempest-ServerActionsTestOtherB-server-1206337114</nova:name>
Aug 26 11:44:45 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:44:45</nova:creationTime>
Aug 26 11:44:45 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:44:45 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:44:45 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:44:45 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:44:45 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:44:45 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:44:45 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:44:45 user nova-compute[73068]:       <nova:owner>
Aug 26 11:44:45 user nova-compute[73068]:         <nova:user uuid="aebb7fd9efa24a4badc4781d49254b54">tempest-ServerActionsTestOtherB-1424792909-project-member</nova:user>
Aug 26 11:44:45 user nova-compute[73068]:         <nova:project uuid="153275ec93514f4bae4e4df5896c1768">tempest-ServerActionsTestOtherB-1424792909</nova:project>
Aug 26 11:44:45 user nova-compute[73068]:       </nova:owner>
Aug 26 11:44:45 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:44:45 user nova-compute[73068]:       <nova:ports>
Aug 26 11:44:45 user nova-compute[73068]:         <nova:port uuid="a6b9bfc5-4a72-4001-83b8-a2f9d4f83415">
Aug 26 11:44:45 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 11:44:45 user nova-compute[73068]:         </nova:port>
Aug 26 11:44:45 user nova-compute[73068]:       </nova:ports>
Aug 26 11:44:45 user nova-compute[73068]:     </nova:instance>
Aug 26 11:44:45 user nova-compute[73068]:   </metadata>
Aug 26 11:44:45 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:44:45 user nova-compute[73068]:     <system>
Aug 26 11:44:45 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:44:45 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:44:45 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:44:45 user nova-compute[73068]:       <entry name="serial">ffe8d8fe-cc8f-44ab-8b95-5db1772b724d</entry>
Aug 26 11:44:45 user nova-compute[73068]:       <entry name="uuid">ffe8d8fe-cc8f-44ab-8b95-5db1772b724d</entry>
Aug 26 11:44:45 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:44:45 user nova-compute[73068]:     </system>
Aug 26 11:44:45 user nova-compute[73068]:   </sysinfo>
Aug 26 11:44:45 user nova-compute[73068]:   <os>
Aug 26 11:44:45 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:44:45 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:44:45 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:44:45 user nova-compute[73068]:   </os>
Aug 26 11:44:45 user nova-compute[73068]:   <features>
Aug 26 11:44:45 user nova-compute[73068]:     <acpi/>
Aug 26 11:44:45 user nova-compute[73068]:     <apic/>
Aug 26 11:44:45 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:44:45 user nova-compute[73068]:   </features>
Aug 26 11:44:45 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:44:45 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:44:45 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:44:45 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:44:45 user nova-compute[73068]:   </clock>
Aug 26 11:44:45 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:44:45 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:44:45 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:44:45 user nova-compute[73068]:   </cpu>
Aug 26 11:44:45 user nova-compute[73068]:   <devices>
Aug 26 11:44:45 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:44:45 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:44:45 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk"/>
Aug 26 11:44:45 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:44:45 user nova-compute[73068]:     </disk>
Aug 26 11:44:45 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:44:45 user nova-compute[73068]:       <mac address="fa:16:3e:e9:29:4c"/>
Aug 26 11:44:45 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:44:45 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:44:45 user nova-compute[73068]:       <target dev="tapa6b9bfc5-4a"/>
Aug 26 11:44:45 user nova-compute[73068]:     </interface>
Aug 26 11:44:45 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:44:45 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/console.log" append="off"/>
Aug 26 11:44:45 user nova-compute[73068]:     </serial>
Aug 26 11:44:45 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:44:45 user nova-compute[73068]:     <video>
Aug 26 11:44:45 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:44:45 user nova-compute[73068]:     </video>
Aug 26 11:44:45 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:44:45 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:44:45 user nova-compute[73068]:     </rng>
Aug 26 11:44:45 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:44:45 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:44:45 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:44:45 user nova-compute[73068]:     </memballoon>
Aug 26 11:44:45 user nova-compute[73068]:   </devices>
Aug 26 11:44:45 user nova-compute[73068]: </domain>
Aug 26 11:44:45 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1206337114',display_name='tempest-ServerActionsTestOtherB-server-1206337114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1206337114',id=23,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFFxO6g28QnEbPVE9eEWN0xxRXJgko1+norortx0+AlfxJbRvBixXIiMb9HAbuSn6UiypXtchzFrG536bQs1YJPVnBRpPK7Gwtx3Hj+XNlG77aJy0AGfgoQcsN3bXpOiw==',key_name='tempest-keypair-1079791633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='153275ec93514f4bae4e4df5896c1768',ramdisk_id='',reservation_id='r-a081kf7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1424792909',owner_user_name='tempest-ServerActionsTestOtherB-1424792909-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aebb7fd9efa24a4badc4781d49254b54',uuid=ffe8d8fe-cc8f-44ab-8b95-5db1772b724d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Converting VIF {"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:29:4c,bridge_name='br-int',has_traffic_filtering=True,id=a6b9bfc5-4a72-4001-83b8-a2f9d4f83415,network=Network(3d6ae9c3-5642-425d-8845-0da423568a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b9bfc5-4a') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG os_vif [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:29:4c,bridge_name='br-int',has_traffic_filtering=True,id=a6b9bfc5-4a72-4001-83b8-a2f9d4f83415,network=Network(3d6ae9c3-5642-425d-8845-0da423568a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b9bfc5-4a') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6b9bfc5-4a, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6b9bfc5-4a, col_values=(('external_ids', {'iface-id': 'a6b9bfc5-4a72-4001-83b8-a2f9d4f83415', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:29:4c', 'vm-uuid': 'ffe8d8fe-cc8f-44ab-8b95-5db1772b724d'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:45 user nova-compute[73068]: INFO os_vif [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:29:4c,bridge_name='br-int',has_traffic_filtering=True,id=a6b9bfc5-4a72-4001-83b8-a2f9d4f83415,network=Network(3d6ae9c3-5642-425d-8845-0da423568a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b9bfc5-4a')
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] No VIF found with MAC fa:16:3e:e9:29:4c, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.network.neutron [req-c44dd5e4-1f65-4b63-ae73-9f5bcd198374 req-d59c8e8a-858c-4abe-8c5b-c7602f5007d6 service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Updated VIF entry in instance network info cache for port a6b9bfc5-4a72-4001-83b8-a2f9d4f83415. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG nova.network.neutron [req-c44dd5e4-1f65-4b63-ae73-9f5bcd198374 req-d59c8e8a-858c-4abe-8c5b-c7602f5007d6 service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Updating instance_info_cache with network_info: [{"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c44dd5e4-1f65-4b63-ae73-9f5bcd198374 req-d59c8e8a-858c-4abe-8c5b-c7602f5007d6 service nova] Releasing lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:44:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-f3fe1bc8-daff-4117-bad9-2121a8d4c250 req-b80f9052-4ee4-40ae-81ad-81eb25f8252d service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Received event network-vif-plugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f3fe1bc8-daff-4117-bad9-2121a8d4c250 req-b80f9052-4ee4-40ae-81ad-81eb25f8252d service nova] Acquiring lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f3fe1bc8-daff-4117-bad9-2121a8d4c250 req-b80f9052-4ee4-40ae-81ad-81eb25f8252d service nova] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f3fe1bc8-daff-4117-bad9-2121a8d4c250 req-b80f9052-4ee4-40ae-81ad-81eb25f8252d service nova] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-f3fe1bc8-daff-4117-bad9-2121a8d4c250 req-b80f9052-4ee4-40ae-81ad-81eb25f8252d service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] No waiting events found dispatching network-vif-plugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:44:46 user nova-compute[73068]: WARNING nova.compute.manager [req-f3fe1bc8-daff-4117-bad9-2121a8d4c250 req-b80f9052-4ee4-40ae-81ad-81eb25f8252d service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Received unexpected event network-vif-plugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 for instance with vm_state building and task_state spawning.
Aug 26 11:44:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050288.7845657, ffe8d8fe-cc8f-44ab-8b95-5db1772b724d => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:44:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] VM Resumed (Lifecycle Event)
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:44:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Instance spawned successfully.
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-22df0506-b576-49c9-a0f1-bdd8d2bee716 req-4627011f-0b3e-45eb-b60c-05516accc6c8 service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Received event network-vif-plugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-22df0506-b576-49c9-a0f1-bdd8d2bee716 req-4627011f-0b3e-45eb-b60c-05516accc6c8 service nova] Acquiring lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-22df0506-b576-49c9-a0f1-bdd8d2bee716 req-4627011f-0b3e-45eb-b60c-05516accc6c8 service nova] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-22df0506-b576-49c9-a0f1-bdd8d2bee716 req-4627011f-0b3e-45eb-b60c-05516accc6c8 service nova] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-22df0506-b576-49c9-a0f1-bdd8d2bee716 req-4627011f-0b3e-45eb-b60c-05516accc6c8 service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] No waiting events found dispatching network-vif-plugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:44:48 user nova-compute[73068]: WARNING nova.compute.manager [req-22df0506-b576-49c9-a0f1-bdd8d2bee716 req-4627011f-0b3e-45eb-b60c-05516accc6c8 service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Received unexpected event network-vif-plugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 for instance with vm_state building and task_state spawning.
Aug 26 11:44:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050288.7867458, ffe8d8fe-cc8f-44ab-8b95-5db1772b724d => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:44:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] VM Started (Lifecycle Event)
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:44:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:44:48 user nova-compute[73068]: INFO nova.compute.manager [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 26 11:44:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:44:48 user nova-compute[73068]: INFO nova.compute.manager [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Took 6.53 seconds to build instance.
Aug 26 11:44:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bb1b3000-96dd-4f28-ae10-e66a953162df tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.624s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:44:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:49 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:44:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:44:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:44:52 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:44:52 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:44:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7732MB free_disk=25.63016128540039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:44:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:44:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:44:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance fba812b3-7791-463f-9c86-a51ae7a7457d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:44:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:44:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 79914502-0e07-4b85-abaa-964bc7350f17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:44:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 5d0fb227-c825-4fe0-afe4-92f351a70f88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:44:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance e1132a5d-535a-4e72-8d03-25ea977f0034 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:44:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ffe8d8fe-cc8f-44ab-8b95-5db1772b724d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:44:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:44:52 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:44:53 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:44:53 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:44:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:44:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:44:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:44:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:44:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:44:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:44:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 26 11:44:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 11:44:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:44:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:44:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:44:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:44:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "1da8ad99-b071-4dad-bda9-d233724bea76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "1da8ad99-b071-4dad-bda9-d233724bea76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:45:11 user nova-compute[73068]: INFO nova.compute.claims [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Claim successful on node user
Aug 26 11:45:11 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:45:11 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:45:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG nova.policy [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5267971a93074e2f86ab0ef72a85cddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6bfa128ef954ce8babddf3df43f17ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:45:11 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Creating image(s)
Aug 26 11:45:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "/opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "/opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "/opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.216s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk 1073741824" returned: 0 in 0.051s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Cannot resize image /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Ensure instance console log exists: /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:12 user nova-compute[73068]: DEBUG nova.network.neutron [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Successfully created port: 20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Successfully updated port: 20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "refresh_cache-1da8ad99-b071-4dad-bda9-d233724bea76" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquired lock "refresh_cache-1da8ad99-b071-4dad-bda9-d233724bea76" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-d579415c-5461-4a95-b630-740405a4bd3c req-789f1311-d2ae-43dc-a84d-0f244c8a7233 service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Received event network-changed-20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-d579415c-5461-4a95-b630-740405a4bd3c req-789f1311-d2ae-43dc-a84d-0f244c8a7233 service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Refreshing instance network info cache due to event network-changed-20176e83-b44b-4bdb-b8ec-ec706a5eab10. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d579415c-5461-4a95-b630-740405a4bd3c req-789f1311-d2ae-43dc-a84d-0f244c8a7233 service nova] Acquiring lock "refresh_cache-1da8ad99-b071-4dad-bda9-d233724bea76" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Updating instance_info_cache with network_info: [{"id": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "address": "fa:16:3e:64:92:72", "network": {"id": "6c9deedf-7371-4bd7-8ede-d8338eb4ddc4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1560996994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6bfa128ef954ce8babddf3df43f17ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20176e83-b4", "ovs_interfaceid": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Releasing lock "refresh_cache-1da8ad99-b071-4dad-bda9-d233724bea76" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Instance network_info: |[{"id": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "address": "fa:16:3e:64:92:72", "network": {"id": "6c9deedf-7371-4bd7-8ede-d8338eb4ddc4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1560996994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6bfa128ef954ce8babddf3df43f17ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20176e83-b4", "ovs_interfaceid": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d579415c-5461-4a95-b630-740405a4bd3c req-789f1311-d2ae-43dc-a84d-0f244c8a7233 service nova] Acquired lock "refresh_cache-1da8ad99-b071-4dad-bda9-d233724bea76" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.network.neutron [req-d579415c-5461-4a95-b630-740405a4bd3c req-789f1311-d2ae-43dc-a84d-0f244c8a7233 service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Refreshing network info cache for port 20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Start _get_guest_xml network_info=[{"id": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "address": "fa:16:3e:64:92:72", "network": {"id": "6c9deedf-7371-4bd7-8ede-d8338eb4ddc4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1560996994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6bfa128ef954ce8babddf3df43f17ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20176e83-b4", "ovs_interfaceid": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:45:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:45:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-393932001',display_name='tempest-DeleteServersTestJSON-server-393932001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-393932001',id=24,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6bfa128ef954ce8babddf3df43f17ff',ramdisk_id='',reservation_id='r-d0w7weuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1219747419',owner_user_name='tempest-DeleteServersTestJSON-1219747419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:45:12Z,user_data=None,user_id='5267971a93074e2f86ab0ef72a85cddc',uuid=1da8ad99-b071-4dad-bda9-d233724bea76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "address": "fa:16:3e:64:92:72", "network": {"id": "6c9deedf-7371-4bd7-8ede-d8338eb4ddc4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1560996994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6bfa128ef954ce8babddf3df43f17ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20176e83-b4", "ovs_interfaceid": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Converting VIF {"id": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "address": "fa:16:3e:64:92:72", "network": {"id": "6c9deedf-7371-4bd7-8ede-d8338eb4ddc4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1560996994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6bfa128ef954ce8babddf3df43f17ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20176e83-b4", "ovs_interfaceid": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:92:72,bridge_name='br-int',has_traffic_filtering=True,id=20176e83-b44b-4bdb-b8ec-ec706a5eab10,network=Network(6c9deedf-7371-4bd7-8ede-d8338eb4ddc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20176e83-b4') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.objects.instance [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lazy-loading 'pci_devices' on Instance uuid 1da8ad99-b071-4dad-bda9-d233724bea76 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:45:13 user nova-compute[73068]:   <uuid>1da8ad99-b071-4dad-bda9-d233724bea76</uuid>
Aug 26 11:45:13 user nova-compute[73068]:   <name>instance-00000018</name>
Aug 26 11:45:13 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:45:13 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:45:13 user nova-compute[73068]:   <metadata>
Aug 26 11:45:13 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:45:13 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:45:13 user nova-compute[73068]:       <nova:name>tempest-DeleteServersTestJSON-server-393932001</nova:name>
Aug 26 11:45:13 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:45:13</nova:creationTime>
Aug 26 11:45:13 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:45:13 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:45:13 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:45:13 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:45:13 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:45:13 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:45:13 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:45:13 user nova-compute[73068]:       <nova:owner>
Aug 26 11:45:13 user nova-compute[73068]:         <nova:user uuid="5267971a93074e2f86ab0ef72a85cddc">tempest-DeleteServersTestJSON-1219747419-project-member</nova:user>
Aug 26 11:45:13 user nova-compute[73068]:         <nova:project uuid="e6bfa128ef954ce8babddf3df43f17ff">tempest-DeleteServersTestJSON-1219747419</nova:project>
Aug 26 11:45:13 user nova-compute[73068]:       </nova:owner>
Aug 26 11:45:13 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:45:13 user nova-compute[73068]:       <nova:ports>
Aug 26 11:45:13 user nova-compute[73068]:         <nova:port uuid="20176e83-b44b-4bdb-b8ec-ec706a5eab10">
Aug 26 11:45:13 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 11:45:13 user nova-compute[73068]:         </nova:port>
Aug 26 11:45:13 user nova-compute[73068]:       </nova:ports>
Aug 26 11:45:13 user nova-compute[73068]:     </nova:instance>
Aug 26 11:45:13 user nova-compute[73068]:   </metadata>
Aug 26 11:45:13 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:45:13 user nova-compute[73068]:     <system>
Aug 26 11:45:13 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:45:13 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:45:13 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:45:13 user nova-compute[73068]:       <entry name="serial">1da8ad99-b071-4dad-bda9-d233724bea76</entry>
Aug 26 11:45:13 user nova-compute[73068]:       <entry name="uuid">1da8ad99-b071-4dad-bda9-d233724bea76</entry>
Aug 26 11:45:13 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:45:13 user nova-compute[73068]:     </system>
Aug 26 11:45:13 user nova-compute[73068]:   </sysinfo>
Aug 26 11:45:13 user nova-compute[73068]:   <os>
Aug 26 11:45:13 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:45:13 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:45:13 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:45:13 user nova-compute[73068]:   </os>
Aug 26 11:45:13 user nova-compute[73068]:   <features>
Aug 26 11:45:13 user nova-compute[73068]:     <acpi/>
Aug 26 11:45:13 user nova-compute[73068]:     <apic/>
Aug 26 11:45:13 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:45:13 user nova-compute[73068]:   </features>
Aug 26 11:45:13 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:45:13 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:45:13 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:45:13 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:45:13 user nova-compute[73068]:   </clock>
Aug 26 11:45:13 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:45:13 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:45:13 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:45:13 user nova-compute[73068]:   </cpu>
Aug 26 11:45:13 user nova-compute[73068]:   <devices>
Aug 26 11:45:13 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:45:13 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:45:13 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk"/>
Aug 26 11:45:13 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:45:13 user nova-compute[73068]:     </disk>
Aug 26 11:45:13 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:45:13 user nova-compute[73068]:       <mac address="fa:16:3e:64:92:72"/>
Aug 26 11:45:13 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:45:13 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:45:13 user nova-compute[73068]:       <target dev="tap20176e83-b4"/>
Aug 26 11:45:13 user nova-compute[73068]:     </interface>
Aug 26 11:45:13 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:45:13 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/console.log" append="off"/>
Aug 26 11:45:13 user nova-compute[73068]:     </serial>
Aug 26 11:45:13 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:45:13 user nova-compute[73068]:     <video>
Aug 26 11:45:13 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:45:13 user nova-compute[73068]:     </video>
Aug 26 11:45:13 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:45:13 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:45:13 user nova-compute[73068]:     </rng>
Aug 26 11:45:13 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:45:13 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:45:13 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:45:13 user nova-compute[73068]:     </memballoon>
Aug 26 11:45:13 user nova-compute[73068]:   </devices>
Aug 26 11:45:13 user nova-compute[73068]: </domain>
Aug 26 11:45:13 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-393932001',display_name='tempest-DeleteServersTestJSON-server-393932001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-393932001',id=24,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6bfa128ef954ce8babddf3df43f17ff',ramdisk_id='',reservation_id='r-d0w7weuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1219747419',owner_user_name='tempest-DeleteServersTestJSON-1219747419-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:45:12Z,user_data=None,user_id='5267971a93074e2f86ab0ef72a85cddc',uuid=1da8ad99-b071-4dad-bda9-d233724bea76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "address": "fa:16:3e:64:92:72", "network": {"id": "6c9deedf-7371-4bd7-8ede-d8338eb4ddc4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1560996994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6bfa128ef954ce8babddf3df43f17ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20176e83-b4", "ovs_interfaceid": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Converting VIF {"id": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "address": "fa:16:3e:64:92:72", "network": {"id": "6c9deedf-7371-4bd7-8ede-d8338eb4ddc4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1560996994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6bfa128ef954ce8babddf3df43f17ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20176e83-b4", "ovs_interfaceid": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:92:72,bridge_name='br-int',has_traffic_filtering=True,id=20176e83-b44b-4bdb-b8ec-ec706a5eab10,network=Network(6c9deedf-7371-4bd7-8ede-d8338eb4ddc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20176e83-b4') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG os_vif [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:92:72,bridge_name='br-int',has_traffic_filtering=True,id=20176e83-b44b-4bdb-b8ec-ec706a5eab10,network=Network(6c9deedf-7371-4bd7-8ede-d8338eb4ddc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20176e83-b4') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20176e83-b4, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20176e83-b4, col_values=(('external_ids', {'iface-id': '20176e83-b44b-4bdb-b8ec-ec706a5eab10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:92:72', 'vm-uuid': '1da8ad99-b071-4dad-bda9-d233724bea76'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:13 user nova-compute[73068]: INFO os_vif [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:92:72,bridge_name='br-int',has_traffic_filtering=True,id=20176e83-b44b-4bdb-b8ec-ec706a5eab10,network=Network(6c9deedf-7371-4bd7-8ede-d8338eb4ddc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20176e83-b4')
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:45:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] No VIF found with MAC fa:16:3e:64:92:72, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:45:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-d579415c-5461-4a95-b630-740405a4bd3c req-789f1311-d2ae-43dc-a84d-0f244c8a7233 service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Updated VIF entry in instance network info cache for port 20176e83-b44b-4bdb-b8ec-ec706a5eab10. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:45:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-d579415c-5461-4a95-b630-740405a4bd3c req-789f1311-d2ae-43dc-a84d-0f244c8a7233 service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Updating instance_info_cache with network_info: [{"id": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "address": "fa:16:3e:64:92:72", "network": {"id": "6c9deedf-7371-4bd7-8ede-d8338eb4ddc4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1560996994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6bfa128ef954ce8babddf3df43f17ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20176e83-b4", "ovs_interfaceid": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:45:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d579415c-5461-4a95-b630-740405a4bd3c req-789f1311-d2ae-43dc-a84d-0f244c8a7233 service nova] Releasing lock "refresh_cache-1da8ad99-b071-4dad-bda9-d233724bea76" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-5849a1c1-e1fc-40c6-bf68-1875eaf4ee7f req-19eb99f3-57c2-4f21-ba29-c1b0a26e3a1b service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Received event network-vif-plugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5849a1c1-e1fc-40c6-bf68-1875eaf4ee7f req-19eb99f3-57c2-4f21-ba29-c1b0a26e3a1b service nova] Acquiring lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5849a1c1-e1fc-40c6-bf68-1875eaf4ee7f req-19eb99f3-57c2-4f21-ba29-c1b0a26e3a1b service nova] Lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5849a1c1-e1fc-40c6-bf68-1875eaf4ee7f req-19eb99f3-57c2-4f21-ba29-c1b0a26e3a1b service nova] Lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-5849a1c1-e1fc-40c6-bf68-1875eaf4ee7f req-19eb99f3-57c2-4f21-ba29-c1b0a26e3a1b service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] No waiting events found dispatching network-vif-plugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:45:15 user nova-compute[73068]: WARNING nova.compute.manager [req-5849a1c1-e1fc-40c6-bf68-1875eaf4ee7f req-19eb99f3-57c2-4f21-ba29-c1b0a26e3a1b service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Received unexpected event network-vif-plugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 for instance with vm_state building and task_state spawning.
Aug 26 11:45:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "33e73e10-0c25-4ec2-880e-1aeb155a8256" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:45:16 user nova-compute[73068]: INFO nova.compute.claims [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Claim successful on node user
Aug 26 11:45:16 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:45:16 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:45:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:45:16 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Creating image(s)
Aug 26 11:45:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "/opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "/opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "/opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:16 user nova-compute[73068]: DEBUG nova.policy [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5ae30c967be457c81a16fdae5b44f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5eb47d0358f4c5b811b316560a66214', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.219s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk 1073741824" returned: 0 in 0.061s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050317.4757438, 1da8ad99-b071-4dad-bda9-d233724bea76 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:45:17 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] VM Resumed (Lifecycle Event)
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:45:17 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Instance spawned successfully.
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:17 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050317.4759765, 1da8ad99-b071-4dad-bda9-d233724bea76 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:45:17 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] VM Started (Lifecycle Event)
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-2f212177-3e00-40e1-b80e-7a7011f8e222 req-f0eb0ceb-5564-47fa-9185-a85071c0eacf service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Received event network-vif-plugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2f212177-3e00-40e1-b80e-7a7011f8e222 req-f0eb0ceb-5564-47fa-9185-a85071c0eacf service nova] Acquiring lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2f212177-3e00-40e1-b80e-7a7011f8e222 req-f0eb0ceb-5564-47fa-9185-a85071c0eacf service nova] Lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2f212177-3e00-40e1-b80e-7a7011f8e222 req-f0eb0ceb-5564-47fa-9185-a85071c0eacf service nova] Lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-2f212177-3e00-40e1-b80e-7a7011f8e222 req-f0eb0ceb-5564-47fa-9185-a85071c0eacf service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] No waiting events found dispatching network-vif-plugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:45:17 user nova-compute[73068]: WARNING nova.compute.manager [req-2f212177-3e00-40e1-b80e-7a7011f8e222 req-f0eb0ceb-5564-47fa-9185-a85071c0eacf service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Received unexpected event network-vif-plugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 for instance with vm_state building and task_state spawning.
Aug 26 11:45:17 user nova-compute[73068]: INFO nova.compute.manager [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:45:17 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Cannot resize image /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Ensure instance console log exists: /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:17 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Successfully created port: 501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:45:17 user nova-compute[73068]: INFO nova.compute.manager [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Took 6.79 seconds to build instance.
Aug 26 11:45:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-af4da95d-b867-4ece-8e4b-9d6120480fd3 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "1da8ad99-b071-4dad-bda9-d233724bea76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.899s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:18 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Successfully updated port: 501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:45:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "refresh_cache-33e73e10-0c25-4ec2-880e-1aeb155a8256" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:45:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquired lock "refresh_cache-33e73e10-0c25-4ec2-880e-1aeb155a8256" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:45:18 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:45:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-f30cdf99-9842-4b5f-9fe8-abc97f8b2fc3 req-43f04fde-a383-454a-80ce-1ed48cbe5d85 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Received event network-changed-501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-f30cdf99-9842-4b5f-9fe8-abc97f8b2fc3 req-43f04fde-a383-454a-80ce-1ed48cbe5d85 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Refreshing instance network info cache due to event network-changed-501f31dd-bfab-479c-9a3d-edc405210f4f. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:45:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f30cdf99-9842-4b5f-9fe8-abc97f8b2fc3 req-43f04fde-a383-454a-80ce-1ed48cbe5d85 service nova] Acquiring lock "refresh_cache-33e73e10-0c25-4ec2-880e-1aeb155a8256" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:45:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:18 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Updating instance_info_cache with network_info: [{"id": "501f31dd-bfab-479c-9a3d-edc405210f4f", "address": "fa:16:3e:0f:39:a7", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501f31dd-bf", "ovs_interfaceid": "501f31dd-bfab-479c-9a3d-edc405210f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Releasing lock "refresh_cache-33e73e10-0c25-4ec2-880e-1aeb155a8256" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Instance network_info: |[{"id": "501f31dd-bfab-479c-9a3d-edc405210f4f", "address": "fa:16:3e:0f:39:a7", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501f31dd-bf", "ovs_interfaceid": "501f31dd-bfab-479c-9a3d-edc405210f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f30cdf99-9842-4b5f-9fe8-abc97f8b2fc3 req-43f04fde-a383-454a-80ce-1ed48cbe5d85 service nova] Acquired lock "refresh_cache-33e73e10-0c25-4ec2-880e-1aeb155a8256" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.network.neutron [req-f30cdf99-9842-4b5f-9fe8-abc97f8b2fc3 req-43f04fde-a383-454a-80ce-1ed48cbe5d85 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Refreshing network info cache for port 501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Start _get_guest_xml network_info=[{"id": "501f31dd-bfab-479c-9a3d-edc405210f4f", "address": "fa:16:3e:0f:39:a7", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501f31dd-bf", "ovs_interfaceid": "501f31dd-bfab-479c-9a3d-edc405210f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:45:19 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:45:19 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-742703543',display_name='tempest-VolumesActionsTest-instance-742703543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-742703543',id=25,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5eb47d0358f4c5b811b316560a66214',ramdisk_id='',reservation_id='r-bhap5bja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1862177138',owner_user_name='tempest-VolumesActionsTest-1862177138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:45:17Z,user_data=None,user_id='c5ae30c967be457c81a16fdae5b44f18',uuid=33e73e10-0c25-4ec2-880e-1aeb155a8256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "501f31dd-bfab-479c-9a3d-edc405210f4f", "address": "fa:16:3e:0f:39:a7", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501f31dd-bf", "ovs_interfaceid": "501f31dd-bfab-479c-9a3d-edc405210f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converting VIF {"id": "501f31dd-bfab-479c-9a3d-edc405210f4f", "address": "fa:16:3e:0f:39:a7", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501f31dd-bf", "ovs_interfaceid": "501f31dd-bfab-479c-9a3d-edc405210f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:39:a7,bridge_name='br-int',has_traffic_filtering=True,id=501f31dd-bfab-479c-9a3d-edc405210f4f,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501f31dd-bf') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lazy-loading 'pci_devices' on Instance uuid 33e73e10-0c25-4ec2-880e-1aeb155a8256 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:45:19 user nova-compute[73068]:   <uuid>33e73e10-0c25-4ec2-880e-1aeb155a8256</uuid>
Aug 26 11:45:19 user nova-compute[73068]:   <name>instance-00000019</name>
Aug 26 11:45:19 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:45:19 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:45:19 user nova-compute[73068]:   <metadata>
Aug 26 11:45:19 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:45:19 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:45:19 user nova-compute[73068]:       <nova:name>tempest-VolumesActionsTest-instance-742703543</nova:name>
Aug 26 11:45:19 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:45:19</nova:creationTime>
Aug 26 11:45:19 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:45:19 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:45:19 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:45:19 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:45:19 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:45:19 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:45:19 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:45:19 user nova-compute[73068]:       <nova:owner>
Aug 26 11:45:19 user nova-compute[73068]:         <nova:user uuid="c5ae30c967be457c81a16fdae5b44f18">tempest-VolumesActionsTest-1862177138-project-member</nova:user>
Aug 26 11:45:19 user nova-compute[73068]:         <nova:project uuid="e5eb47d0358f4c5b811b316560a66214">tempest-VolumesActionsTest-1862177138</nova:project>
Aug 26 11:45:19 user nova-compute[73068]:       </nova:owner>
Aug 26 11:45:19 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:45:19 user nova-compute[73068]:       <nova:ports>
Aug 26 11:45:19 user nova-compute[73068]:         <nova:port uuid="501f31dd-bfab-479c-9a3d-edc405210f4f">
Aug 26 11:45:19 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 11:45:19 user nova-compute[73068]:         </nova:port>
Aug 26 11:45:19 user nova-compute[73068]:       </nova:ports>
Aug 26 11:45:19 user nova-compute[73068]:     </nova:instance>
Aug 26 11:45:19 user nova-compute[73068]:   </metadata>
Aug 26 11:45:19 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:45:19 user nova-compute[73068]:     <system>
Aug 26 11:45:19 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:45:19 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:45:19 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:45:19 user nova-compute[73068]:       <entry name="serial">33e73e10-0c25-4ec2-880e-1aeb155a8256</entry>
Aug 26 11:45:19 user nova-compute[73068]:       <entry name="uuid">33e73e10-0c25-4ec2-880e-1aeb155a8256</entry>
Aug 26 11:45:19 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:45:19 user nova-compute[73068]:     </system>
Aug 26 11:45:19 user nova-compute[73068]:   </sysinfo>
Aug 26 11:45:19 user nova-compute[73068]:   <os>
Aug 26 11:45:19 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:45:19 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:45:19 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:45:19 user nova-compute[73068]:   </os>
Aug 26 11:45:19 user nova-compute[73068]:   <features>
Aug 26 11:45:19 user nova-compute[73068]:     <acpi/>
Aug 26 11:45:19 user nova-compute[73068]:     <apic/>
Aug 26 11:45:19 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:45:19 user nova-compute[73068]:   </features>
Aug 26 11:45:19 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:45:19 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:45:19 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:45:19 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:45:19 user nova-compute[73068]:   </clock>
Aug 26 11:45:19 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:45:19 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:45:19 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:45:19 user nova-compute[73068]:   </cpu>
Aug 26 11:45:19 user nova-compute[73068]:   <devices>
Aug 26 11:45:19 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:45:19 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:45:19 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk"/>
Aug 26 11:45:19 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:45:19 user nova-compute[73068]:     </disk>
Aug 26 11:45:19 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:45:19 user nova-compute[73068]:       <mac address="fa:16:3e:0f:39:a7"/>
Aug 26 11:45:19 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:45:19 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:45:19 user nova-compute[73068]:       <target dev="tap501f31dd-bf"/>
Aug 26 11:45:19 user nova-compute[73068]:     </interface>
Aug 26 11:45:19 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:45:19 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/console.log" append="off"/>
Aug 26 11:45:19 user nova-compute[73068]:     </serial>
Aug 26 11:45:19 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:45:19 user nova-compute[73068]:     <video>
Aug 26 11:45:19 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:45:19 user nova-compute[73068]:     </video>
Aug 26 11:45:19 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:45:19 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:45:19 user nova-compute[73068]:     </rng>
Aug 26 11:45:19 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:45:19 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:45:19 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:45:19 user nova-compute[73068]:     </memballoon>
Aug 26 11:45:19 user nova-compute[73068]:   </devices>
Aug 26 11:45:19 user nova-compute[73068]: </domain>
Aug 26 11:45:19 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-742703543',display_name='tempest-VolumesActionsTest-instance-742703543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-742703543',id=25,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e5eb47d0358f4c5b811b316560a66214',ramdisk_id='',reservation_id='r-bhap5bja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1862177138',owner_user_name='tempest-VolumesActionsTest-1862177138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:45:17Z,user_data=None,user_id='c5ae30c967be457c81a16fdae5b44f18',uuid=33e73e10-0c25-4ec2-880e-1aeb155a8256,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "501f31dd-bfab-479c-9a3d-edc405210f4f", "address": "fa:16:3e:0f:39:a7", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501f31dd-bf", "ovs_interfaceid": "501f31dd-bfab-479c-9a3d-edc405210f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converting VIF {"id": "501f31dd-bfab-479c-9a3d-edc405210f4f", "address": "fa:16:3e:0f:39:a7", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501f31dd-bf", "ovs_interfaceid": "501f31dd-bfab-479c-9a3d-edc405210f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:39:a7,bridge_name='br-int',has_traffic_filtering=True,id=501f31dd-bfab-479c-9a3d-edc405210f4f,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501f31dd-bf') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG os_vif [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:39:a7,bridge_name='br-int',has_traffic_filtering=True,id=501f31dd-bfab-479c-9a3d-edc405210f4f,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501f31dd-bf') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap501f31dd-bf, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap501f31dd-bf, col_values=(('external_ids', {'iface-id': '501f31dd-bfab-479c-9a3d-edc405210f4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:39:a7', 'vm-uuid': '33e73e10-0c25-4ec2-880e-1aeb155a8256'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:19 user nova-compute[73068]: INFO os_vif [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:39:a7,bridge_name='br-int',has_traffic_filtering=True,id=501f31dd-bfab-479c-9a3d-edc405210f4f,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501f31dd-bf')
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] No VIF found with MAC fa:16:3e:0f:39:a7, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.network.neutron [req-f30cdf99-9842-4b5f-9fe8-abc97f8b2fc3 req-43f04fde-a383-454a-80ce-1ed48cbe5d85 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Updated VIF entry in instance network info cache for port 501f31dd-bfab-479c-9a3d-edc405210f4f. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG nova.network.neutron [req-f30cdf99-9842-4b5f-9fe8-abc97f8b2fc3 req-43f04fde-a383-454a-80ce-1ed48cbe5d85 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Updating instance_info_cache with network_info: [{"id": "501f31dd-bfab-479c-9a3d-edc405210f4f", "address": "fa:16:3e:0f:39:a7", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501f31dd-bf", "ovs_interfaceid": "501f31dd-bfab-479c-9a3d-edc405210f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:45:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f30cdf99-9842-4b5f-9fe8-abc97f8b2fc3 req-43f04fde-a383-454a-80ce-1ed48cbe5d85 service nova] Releasing lock "refresh_cache-33e73e10-0c25-4ec2-880e-1aeb155a8256" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:45:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-8b073e7b-0a2b-442d-bf98-32f76fbdfd61 req-b134810d-5b29-4ed6-bd2c-0c9e672db23f service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Received event network-vif-plugged-501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8b073e7b-0a2b-442d-bf98-32f76fbdfd61 req-b134810d-5b29-4ed6-bd2c-0c9e672db23f service nova] Acquiring lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8b073e7b-0a2b-442d-bf98-32f76fbdfd61 req-b134810d-5b29-4ed6-bd2c-0c9e672db23f service nova] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8b073e7b-0a2b-442d-bf98-32f76fbdfd61 req-b134810d-5b29-4ed6-bd2c-0c9e672db23f service nova] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-8b073e7b-0a2b-442d-bf98-32f76fbdfd61 req-b134810d-5b29-4ed6-bd2c-0c9e672db23f service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] No waiting events found dispatching network-vif-plugged-501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:45:21 user nova-compute[73068]: WARNING nova.compute.manager [req-8b073e7b-0a2b-442d-bf98-32f76fbdfd61 req-b134810d-5b29-4ed6-bd2c-0c9e672db23f service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Received unexpected event network-vif-plugged-501f31dd-bfab-479c-9a3d-edc405210f4f for instance with vm_state building and task_state spawning.
Aug 26 11:45:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-03002e5e-b48d-44db-b351-a0b9dbbd9ba8 req-c55cf24c-cc50-4af8-9197-cc0ce46d06a5 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Received event network-vif-plugged-501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-03002e5e-b48d-44db-b351-a0b9dbbd9ba8 req-c55cf24c-cc50-4af8-9197-cc0ce46d06a5 service nova] Acquiring lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-03002e5e-b48d-44db-b351-a0b9dbbd9ba8 req-c55cf24c-cc50-4af8-9197-cc0ce46d06a5 service nova] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-03002e5e-b48d-44db-b351-a0b9dbbd9ba8 req-c55cf24c-cc50-4af8-9197-cc0ce46d06a5 service nova] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-03002e5e-b48d-44db-b351-a0b9dbbd9ba8 req-c55cf24c-cc50-4af8-9197-cc0ce46d06a5 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] No waiting events found dispatching network-vif-plugged-501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:45:23 user nova-compute[73068]: WARNING nova.compute.manager [req-03002e5e-b48d-44db-b351-a0b9dbbd9ba8 req-c55cf24c-cc50-4af8-9197-cc0ce46d06a5 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Received unexpected event network-vif-plugged-501f31dd-bfab-479c-9a3d-edc405210f4f for instance with vm_state building and task_state spawning.
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050323.2104301, 33e73e10-0c25-4ec2-880e-1aeb155a8256 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:45:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] VM Resumed (Lifecycle Event)
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:45:23 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Instance spawned successfully.
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050323.213709, 33e73e10-0c25-4ec2-880e-1aeb155a8256 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:45:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] VM Started (Lifecycle Event)
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:45:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:45:23 user nova-compute[73068]: INFO nova.compute.manager [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Took 6.47 seconds to spawn the instance on the hypervisor.
Aug 26 11:45:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:45:23 user nova-compute[73068]: INFO nova.compute.manager [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Took 7.33 seconds to build instance.
Aug 26 11:45:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b14f5769-fb6c-4d27-8077-f6ac604c63c4 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.441s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-c69e3b31-4405-40cb-8999-b36dc7db7f93 req-0a92aec6-2e55-4a5a-84a8-4db0fc70cfb5 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Received event network-changed-1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-c69e3b31-4405-40cb-8999-b36dc7db7f93 req-0a92aec6-2e55-4a5a-84a8-4db0fc70cfb5 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Refreshing instance network info cache due to event network-changed-1858f5b5-9e7e-45b1-8a55-29dedc5356ae. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:45:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c69e3b31-4405-40cb-8999-b36dc7db7f93 req-0a92aec6-2e55-4a5a-84a8-4db0fc70cfb5 service nova] Acquiring lock "refresh_cache-79914502-0e07-4b85-abaa-964bc7350f17" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:45:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c69e3b31-4405-40cb-8999-b36dc7db7f93 req-0a92aec6-2e55-4a5a-84a8-4db0fc70cfb5 service nova] Acquired lock "refresh_cache-79914502-0e07-4b85-abaa-964bc7350f17" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:45:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-c69e3b31-4405-40cb-8999-b36dc7db7f93 req-0a92aec6-2e55-4a5a-84a8-4db0fc70cfb5 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Refreshing network info cache for port 1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:45:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-c69e3b31-4405-40cb-8999-b36dc7db7f93 req-0a92aec6-2e55-4a5a-84a8-4db0fc70cfb5 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Updated VIF entry in instance network info cache for port 1858f5b5-9e7e-45b1-8a55-29dedc5356ae. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:45:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-c69e3b31-4405-40cb-8999-b36dc7db7f93 req-0a92aec6-2e55-4a5a-84a8-4db0fc70cfb5 service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Updating instance_info_cache with network_info: [{"id": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "address": "fa:16:3e:7d:00:73", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1858f5b5-9e", "ovs_interfaceid": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:45:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c69e3b31-4405-40cb-8999-b36dc7db7f93 req-0a92aec6-2e55-4a5a-84a8-4db0fc70cfb5 service nova] Releasing lock "refresh_cache-79914502-0e07-4b85-abaa-964bc7350f17" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:45:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "79914502-0e07-4b85-abaa-964bc7350f17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'flavor' on Instance uuid 79914502-0e07-4b85-abaa-964bc7350f17 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "79914502-0e07-4b85-abaa-964bc7350f17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:38 user nova-compute[73068]: INFO nova.compute.manager [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Attaching volume 60472097-b77c-4e15-bb9d-9a81a08850ef to /dev/vdb
Aug 26 11:45:38 user nova-compute[73068]: DEBUG os_brick.utils [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1119e699-1794-4046-85b7-3e711b3d86d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[872fdcb9-d26b-4b5c-a39a-7ad2a19fadde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dd5dab-6be8-47bf-a761-bdfc1d42492d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[524fd852-4b10-41d8-811d-3c9fa222a2fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:45:38 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:45:38 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[204fb8e6-1c6e-47ca-9291-d28033cca71c]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG os_brick.utils [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:45:38 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Updating existing volume attachment record: 7c62b2d4-5ceb-4ea7-bb36-3364b9fc6076 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:45:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-bcaed3ff-7639-4bb9-b1c2-7192d49acc3e req-af3bb660-a3f8-4964-85bc-99a757c5466b service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Received event network-changed-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-bcaed3ff-7639-4bb9-b1c2-7192d49acc3e req-af3bb660-a3f8-4964-85bc-99a757c5466b service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Refreshing instance network info cache due to event network-changed-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:45:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bcaed3ff-7639-4bb9-b1c2-7192d49acc3e req-af3bb660-a3f8-4964-85bc-99a757c5466b service nova] Acquiring lock "refresh_cache-5d0fb227-c825-4fe0-afe4-92f351a70f88" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:45:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bcaed3ff-7639-4bb9-b1c2-7192d49acc3e req-af3bb660-a3f8-4964-85bc-99a757c5466b service nova] Acquired lock "refresh_cache-5d0fb227-c825-4fe0-afe4-92f351a70f88" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:45:39 user nova-compute[73068]: DEBUG nova.network.neutron [req-bcaed3ff-7639-4bb9-b1c2-7192d49acc3e req-af3bb660-a3f8-4964-85bc-99a757c5466b service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Refreshing network info cache for port 8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:45:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:39 user nova-compute[73068]: DEBUG nova.objects.instance [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lazy-loading 'flavor' on Instance uuid 5d0fb227-c825-4fe0-afe4-92f351a70f88 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:45:39 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Ignoring supplied device name: /dev/vdb
Aug 26 11:45:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:40 user nova-compute[73068]: INFO nova.compute.manager [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Attaching volume df37f7fb-d515-4f53-a2f4-fedeaebe3712 to /dev/vdb
Aug 26 11:45:40 user nova-compute[73068]: DEBUG os_brick.utils [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[92190451-53d1-42da-95d7-d58ca2c57775]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG nova.network.neutron [req-bcaed3ff-7639-4bb9-b1c2-7192d49acc3e req-af3bb660-a3f8-4964-85bc-99a757c5466b service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Updated VIF entry in instance network info cache for port 8b8e3ed4-51d1-4535-ac62-c0d3a1f30479. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG nova.network.neutron [req-bcaed3ff-7639-4bb9-b1c2-7192d49acc3e req-af3bb660-a3f8-4964-85bc-99a757c5466b service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Updating instance_info_cache with network_info: [{"id": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "address": "fa:16:3e:b3:d5:be", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8e3ed4-51", "ovs_interfaceid": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7ad679-2de6-44b3-878d-530ccbbe9a54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bcaed3ff-7639-4bb9-b1c2-7192d49acc3e req-af3bb660-a3f8-4964-85bc-99a757c5466b service nova] Releasing lock "refresh_cache-5d0fb227-c825-4fe0-afe4-92f351a70f88" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5548761-bd07-4c91-90f2-a918ef26099f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[833dc491-5979-4ece-87f1-0481fd90ea64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:45:40 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:45:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff717b4d-3694-49ce-b8cc-dedb2b6b04a9]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG os_brick.utils [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Updating existing volume attachment record: 9b8c8d01-551b-462e-a882-6ff5075eb78c {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:45:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-d955b52c-12f3-4ef8-bd2d-d335af52a592 req-277b727a-97eb-4aee-b567-4ef2ec23b7b6 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received event network-changed-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-d955b52c-12f3-4ef8-bd2d-d335af52a592 req-277b727a-97eb-4aee-b567-4ef2ec23b7b6 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Refreshing instance network info cache due to event network-changed-eaf16461-99d5-49ab-8498-476d74edd0bd. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d955b52c-12f3-4ef8-bd2d-d335af52a592 req-277b727a-97eb-4aee-b567-4ef2ec23b7b6 service nova] Acquiring lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d955b52c-12f3-4ef8-bd2d-d335af52a592 req-277b727a-97eb-4aee-b567-4ef2ec23b7b6 service nova] Acquired lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-d955b52c-12f3-4ef8-bd2d-d335af52a592 req-277b727a-97eb-4aee-b567-4ef2ec23b7b6 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Refreshing network info cache for port eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "e1132a5d-535a-4e72-8d03-25ea977f0034" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG nova.objects.instance [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lazy-loading 'flavor' on Instance uuid e1132a5d-535a-4e72-8d03-25ea977f0034 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-d955b52c-12f3-4ef8-bd2d-d335af52a592 req-277b727a-97eb-4aee-b567-4ef2ec23b7b6 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updated VIF entry in instance network info cache for port eaf16461-99d5-49ab-8498-476d74edd0bd. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-d955b52c-12f3-4ef8-bd2d-d335af52a592 req-277b727a-97eb-4aee-b567-4ef2ec23b7b6 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updating instance_info_cache with network_info: [{"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d955b52c-12f3-4ef8-bd2d-d335af52a592 req-277b727a-97eb-4aee-b567-4ef2ec23b7b6 service nova] Releasing lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:45:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "e1132a5d-535a-4e72-8d03-25ea977f0034" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:42 user nova-compute[73068]: INFO nova.compute.manager [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Attaching volume 7228862b-9cfb-4bb9-9474-820a97139ef7 to /dev/vdb
Aug 26 11:45:42 user nova-compute[73068]: DEBUG os_brick.utils [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.090s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51bfa50-9a59-4e63-9307-4df2e04f3533]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f961cfa-11c5-418c-8ea6-a9454787cba7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5181cbe-0eb7-45f2-af26-0de31aa7e087]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0054eca3-e21c-447d-8a50-72ef1fc3d5c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:45:42 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:45:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf0085a-ec48-4799-9b05-04b90a6830ea]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG os_brick.utils [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] <== get_connector_properties: return (229ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updating existing volume attachment record: f75cff59-3fc7-46f0-b4e7-87d532bda91d {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:45:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:45:48 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:45:48 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:45:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:45:49 user nova-compute[73068]: INFO nova.compute.claims [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Claim successful on node user
Aug 26 11:45:49 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.230s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG nova.network.neutron [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:45:49 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:45:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG nova.policy [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f8285bc9bf348289c10e62f2179a266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a6670af78b4f6ea72a6d4bc4274c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:45:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:45:50 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Creating image(s)
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "/opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "/opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "/opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.226s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.207s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk 1073741824" returned: 0 in 0.077s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Successfully created port: 33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.255s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Cannot resize image /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Ensure instance console log exists: /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWZYJwBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:45:51 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:45:51 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:45:51 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[152cd3ad-4cf1-4e7e-b4a5-70d0b852b1c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:45:51 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c7fa2e-b583-4453-a2be-826f4332add8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef] added
Aug 26 11:45:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c142e11-6ad2-4b70-ba78-ad443e3e0bc7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc4c087-b0cf-4f8e-b251-cb69e01f89a3]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mWZYJwBl {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mWZYJwBl" returned: 0 in 0.033s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[207e88d4-a6cd-4d81-b45e-3991a32f68c4]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mWZYJwBl'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c791c2-7f6e-4e20-9a41-862cc73f7f1c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Successfully updated port: 33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa43fdd7-8c90-4366-a51a-cd1c54557f7b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 11:45:51 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 11:45:51 user nova-compute[73068]:  {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:45:51 user nova-compute[73068]: WARNING os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 11:45:51 user nova-compute[73068]: 
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquired lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-be2dced5-d003-4c66-8a64-a0724af0acf0 req-6d716a56-36f9-4370-a533-f5be6df8a9b1 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-changed-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-be2dced5-d003-4c66-8a64-a0724af0acf0 req-6d716a56-36f9-4370-a533-f5be6df8a9b1 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Refreshing instance network info cache due to event network-changed-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2dced5-d003-4c66-8a64-a0724af0acf0 req-6d716a56-36f9-4370-a533-f5be6df8a9b1 service nova] Acquiring lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[66677d21-e119-4579-b4c5-873de4a9ee25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef, portal: 172.16.0.220,3260]
Aug 26 11:45:51 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef, portal: 172.16.0.220,3260] successful.
Aug 26 11:45:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb0de64-8113-47cf-ad81-cee35307b8ec]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG nova.network.neutron [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cfeebc-c54d-492b-8fc9-bd9dba643c09]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb43625b-a31e-4e78-8120-5ad36859ba71]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWZYJwBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.network.neutron [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Updating instance_info_cache with network_info: [{"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Releasing lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance network_info: |[{"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2dced5-d003-4c66-8a64-a0724af0acf0 req-6d716a56-36f9-4370-a533-f5be6df8a9b1 service nova] Acquired lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.network.neutron [req-be2dced5-d003-4c66-8a64-a0724af0acf0 req-6d716a56-36f9-4370-a533-f5be6df8a9b1 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Refreshing network info cache for port 33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Start _get_guest_xml network_info=[{"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:45:52 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:45:52 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1855087128',display_name='tempest-AttachVolumeTestJSON-server-1855087128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1855087128',id=26,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8/mwF03MO1idO5kBsZjsTp9Quy8BbKtqGmyu/n7Yopwmv48cZnAqzWvqSKmsD2RP5jFSLkf0tUc/twQBPAIG/iXiF3VVNSEjceHGc2pPBap5FwQEeGG3wjFrME3DLEA==',key_name='tempest-keypair-477742915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-mdlqzffh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=41ef2264-c365-44ee-b4aa-8266e3537c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.objects.instance [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'pci_devices' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:45:52 user nova-compute[73068]:   <uuid>41ef2264-c365-44ee-b4aa-8266e3537c73</uuid>
Aug 26 11:45:52 user nova-compute[73068]:   <name>instance-0000001a</name>
Aug 26 11:45:52 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:45:52 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:45:52 user nova-compute[73068]:   <metadata>
Aug 26 11:45:52 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:45:52 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:45:52 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeTestJSON-server-1855087128</nova:name>
Aug 26 11:45:52 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:45:52</nova:creationTime>
Aug 26 11:45:52 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:45:52 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:45:52 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:45:52 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:45:52 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:45:52 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:45:52 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:45:52 user nova-compute[73068]:       <nova:owner>
Aug 26 11:45:52 user nova-compute[73068]:         <nova:user uuid="9f8285bc9bf348289c10e62f2179a266">tempest-AttachVolumeTestJSON-1485056682-project-member</nova:user>
Aug 26 11:45:52 user nova-compute[73068]:         <nova:project uuid="58a6670af78b4f6ea72a6d4bc4274c31">tempest-AttachVolumeTestJSON-1485056682</nova:project>
Aug 26 11:45:52 user nova-compute[73068]:       </nova:owner>
Aug 26 11:45:52 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:45:52 user nova-compute[73068]:       <nova:ports>
Aug 26 11:45:52 user nova-compute[73068]:         <nova:port uuid="33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea">
Aug 26 11:45:52 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 11:45:52 user nova-compute[73068]:         </nova:port>
Aug 26 11:45:52 user nova-compute[73068]:       </nova:ports>
Aug 26 11:45:52 user nova-compute[73068]:     </nova:instance>
Aug 26 11:45:52 user nova-compute[73068]:   </metadata>
Aug 26 11:45:52 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:45:52 user nova-compute[73068]:     <system>
Aug 26 11:45:52 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:45:52 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:45:52 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:45:52 user nova-compute[73068]:       <entry name="serial">41ef2264-c365-44ee-b4aa-8266e3537c73</entry>
Aug 26 11:45:52 user nova-compute[73068]:       <entry name="uuid">41ef2264-c365-44ee-b4aa-8266e3537c73</entry>
Aug 26 11:45:52 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:45:52 user nova-compute[73068]:     </system>
Aug 26 11:45:52 user nova-compute[73068]:   </sysinfo>
Aug 26 11:45:52 user nova-compute[73068]:   <os>
Aug 26 11:45:52 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:45:52 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:45:52 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:45:52 user nova-compute[73068]:   </os>
Aug 26 11:45:52 user nova-compute[73068]:   <features>
Aug 26 11:45:52 user nova-compute[73068]:     <acpi/>
Aug 26 11:45:52 user nova-compute[73068]:     <apic/>
Aug 26 11:45:52 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:45:52 user nova-compute[73068]:   </features>
Aug 26 11:45:52 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:45:52 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:45:52 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:45:52 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:45:52 user nova-compute[73068]:   </clock>
Aug 26 11:45:52 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:45:52 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:45:52 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:45:52 user nova-compute[73068]:   </cpu>
Aug 26 11:45:52 user nova-compute[73068]:   <devices>
Aug 26 11:45:52 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:45:52 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:45:52 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk"/>
Aug 26 11:45:52 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:45:52 user nova-compute[73068]:     </disk>
Aug 26 11:45:52 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:45:52 user nova-compute[73068]:       <mac address="fa:16:3e:eb:08:a7"/>
Aug 26 11:45:52 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:45:52 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:45:52 user nova-compute[73068]:       <target dev="tap33fb27ef-8c"/>
Aug 26 11:45:52 user nova-compute[73068]:     </interface>
Aug 26 11:45:52 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:45:52 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/console.log" append="off"/>
Aug 26 11:45:52 user nova-compute[73068]:     </serial>
Aug 26 11:45:52 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:45:52 user nova-compute[73068]:     <video>
Aug 26 11:45:52 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:45:52 user nova-compute[73068]:     </video>
Aug 26 11:45:52 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:45:52 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:45:52 user nova-compute[73068]:     </rng>
Aug 26 11:45:52 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:45:52 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:45:52 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:45:52 user nova-compute[73068]:     </memballoon>
Aug 26 11:45:52 user nova-compute[73068]:   </devices>
Aug 26 11:45:52 user nova-compute[73068]: </domain>
Aug 26 11:45:52 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1855087128',display_name='tempest-AttachVolumeTestJSON-server-1855087128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1855087128',id=26,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8/mwF03MO1idO5kBsZjsTp9Quy8BbKtqGmyu/n7Yopwmv48cZnAqzWvqSKmsD2RP5jFSLkf0tUc/twQBPAIG/iXiF3VVNSEjceHGc2pPBap5FwQEeGG3wjFrME3DLEA==',key_name='tempest-keypair-477742915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-mdlqzffh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=41ef2264-c365-44ee-b4aa-8266e3537c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG os_vif [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33fb27ef-8c, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33fb27ef-8c, col_values=(('external_ids', {'iface-id': '33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:08:a7', 'vm-uuid': '41ef2264-c365-44ee-b4aa-8266e3537c73'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZQnKUyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:45:52 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:45:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:52 user nova-compute[73068]: INFO os_vif [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c')
Aug 26 11:45:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23637313332623133', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637313332623133', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.034s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:45:52 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:45:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:45:52 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.objects.instance [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'flavor' on Instance uuid 79914502-0e07-4b85-abaa-964bc7350f17 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[425727cc-8c55-45ab-b7ea-601b1769f9fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:45:52 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:45:52 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:45:52 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:45:52 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:45:52 user nova-compute[73068]:   <serial>60472097-b77c-4e15-bb9d-9a81a08850ef</serial>
Aug 26 11:45:52 user nova-compute[73068]: </disk>
Aug 26 11:45:52 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a84e1e5-dab8-49c3-aeb0-8b510a09d7a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712] added
Aug 26 11:45:52 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No VIF found with MAC fa:16:3e:eb:08:a7, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:45:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35673dd-01ef-45f9-8c7a-2dc485b2255b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba56d331-32aa-490d-b72a-656dc3741a51]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZQnKUyR {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZQnKUyR" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7805638f-b8dc-4a8b-830f-e99c5e3ab75d]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tZQnKUyR'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c822fb4b-9a42-4b90-9221-0a4728c32973]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91e9de4-f2fe-440a-ab0b-1dd0fe7b16f9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[219d2d29-bb6f-4fe8-8e3a-2600c5e12818]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712, portal: 172.16.0.220,3260]
Aug 26 11:45:53 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712, portal: 172.16.0.220,3260] successful.
Aug 26 11:45:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3a9897-d9c7-4700-8993-dc5e0c8fb7e0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4210993-4056-4c3e-8377-e930c919fd52]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:53 user nova-compute[73068]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:45:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:53 user nova-compute[73068]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:45:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f67ed2-a1a4-4e18-a04a-9eb96f0e35d5]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG nova.network.neutron [req-be2dced5-d003-4c66-8a64-a0724af0acf0 req-6d716a56-36f9-4370-a533-f5be6df8a9b1 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Updated VIF entry in instance network info cache for port 33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG nova.network.neutron [req-be2dced5-d003-4c66-8a64-a0724af0acf0 req-6d716a56-36f9-4370-a533-f5be6df8a9b1 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Updating instance_info_cache with network_info: [{"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-be2dced5-d003-4c66-8a64-a0724af0acf0 req-6d716a56-36f9-4370-a533-f5be6df8a9b1 service nova] Releasing lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No VIF found with MAC fa:16:3e:7d:00:73, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:45:53 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:45:53 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:45:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7398MB free_disk=25.53160858154297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dc3b7029-7b10-4bf4-bb8b-92d6304b5619 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.592s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance fba812b3-7791-463f-9c86-a51ae7a7457d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 79914502-0e07-4b85-abaa-964bc7350f17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 5d0fb227-c825-4fe0-afe4-92f351a70f88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance e1132a5d-535a-4e72-8d03-25ea977f0034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ffe8d8fe-cc8f-44ab-8b95-5db1772b724d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 1da8ad99-b071-4dad-bda9-d233724bea76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 33e73e10-0c25-4ec2-880e-1aeb155a8256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 41ef2264-c365-44ee-b4aa-8266e3537c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZQnKUyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23937646138336635', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937646138336635', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.objects.instance [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lazy-loading 'flavor' on Instance uuid 5d0fb227-c825-4fe0-afe4-92f351a70f88 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:45:54 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:45:54 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:45:54 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:45:54 user nova-compute[73068]:   <serial>df37f7fb-d515-4f53-a2f4-fedeaebe3712</serial>
Aug 26 11:45:54 user nova-compute[73068]: </disk>
Aug 26 11:45:54 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] No VIF found with MAC fa:16:3e:b3:d5:be, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:45:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6fb66203-35b1-4b17-8d12-70704ee399c4 tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.902s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-7098b660-3139-446e-97eb-924e9f7f3444 req-5d7bfb6a-1be3-458c-a5b2-4534ca3793fd service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7098b660-3139-446e-97eb-924e9f7f3444 req-5d7bfb6a-1be3-458c-a5b2-4534ca3793fd service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7098b660-3139-446e-97eb-924e9f7f3444 req-5d7bfb6a-1be3-458c-a5b2-4534ca3793fd service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7098b660-3139-446e-97eb-924e9f7f3444 req-5d7bfb6a-1be3-458c-a5b2-4534ca3793fd service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-7098b660-3139-446e-97eb-924e9f7f3444 req-5d7bfb6a-1be3-458c-a5b2-4534ca3793fd service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:45:55 user nova-compute[73068]: WARNING nova.compute.manager [req-7098b660-3139-446e-97eb-924e9f7f3444 req-5d7bfb6a-1be3-458c-a5b2-4534ca3793fd service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received unexpected event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with vm_state building and task_state spawning.
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "79914502-0e07-4b85-abaa-964bc7350f17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:55 user nova-compute[73068]: INFO nova.compute.manager [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Detaching volume 60472097-b77c-4e15-bb9d-9a81a08850ef
Aug 26 11:45:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVgtGjPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:45:55 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:45:55 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:45:55 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:55 user nova-compute[73068]: INFO nova.virt.block_device [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Attempting to driver detach volume 60472097-b77c-4e15-bb9d-9a81a08850ef from mountpoint /dev/vdb
Aug 26 11:45:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Attempting to detach device vdb from instance 79914502-0e07-4b85-abaa-964bc7350f17 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:45:55 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:45:55 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:45:55 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:45:55 user nova-compute[73068]:   <serial>60472097-b77c-4e15-bb9d-9a81a08850ef</serial>
Aug 26 11:45:55 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:45:55 user nova-compute[73068]: </disk>
Aug 26 11:45:55 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[67860cb0-a45b-4be7-8bcb-5cceb4f4e4f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:45:55 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:55 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully detached device vdb from instance 79914502-0e07-4b85-abaa-964bc7350f17 from the persistent domain config.
Aug 26 11:45:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79914502-0e07-4b85-abaa-964bc7350f17 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:45:55 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:45:55 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:45:55 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:45:55 user nova-compute[73068]:   <serial>60472097-b77c-4e15-bb9d-9a81a08850ef</serial>
Aug 26 11:45:55 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:45:55 user nova-compute[73068]: </disk>
Aug 26 11:45:55 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13ae440-5a69-42a2-a014-88ae8197b92e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7] added
Aug 26 11:45:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8986b2ba-165d-4d2d-89e6-10994426a662]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3721f147-7ed6-4603-8ab5-21da2a8c5d5a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SVgtGjPp {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SVgtGjPp" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[312ac475-c992-40dc-9e84-3b33816ca1ab]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SVgtGjPp'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d745940-a977-41e2-a2da-e00e05557ab8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b203be31-027c-4aba-a6e2-0a9f073dc7a0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:55 user nova-compute[73068]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:45:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:55 user nova-compute[73068]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:45:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe50b82-8e85-4e53-a780-811f7810b064]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7, portal: 172.16.0.220,3260]
Aug 26 11:45:55 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7, portal: 172.16.0.220,3260] successful.
Aug 26 11:45:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a092a120-98c5-46c6-bca7-ade43dad91e7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb25203-b60c-4eae-82bb-ac4fdc774d83]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:55 user nova-compute[73068]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:45:55 user nova-compute[73068]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 (non-flash)
Aug 26 11:45:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:55 user nova-compute[73068]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:45:55 user nova-compute[73068]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 (non-flash)
Aug 26 11:45:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b471dbb-50f5-4df1-bccd-b9974ea656bf]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:45:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVgtGjPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:45:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050356.183382, 79914502-0e07-4b85-abaa-964bc7350f17 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:45:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79914502-0e07-4b85-abaa-964bc7350f17 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:45:56 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully detached device vdb from instance 79914502-0e07-4b85-abaa-964bc7350f17 from the live domain config.
Aug 26 11:45:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:45:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mWZYJwBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:45:56 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:45:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:45:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:45:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23038623666333264', 'path': '/dev/sdd'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:45:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038623666333264', 'path': '/dev/sdd'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:45:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.785s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:45:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:45:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:56 user nova-compute[73068]: DEBUG nova.objects.instance [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lazy-loading 'flavor' on Instance uuid e1132a5d-535a-4e72-8d03-25ea977f0034 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[901eb3ee-b28b-4056-9bb7-f778c8a4135a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:45:57 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:45:57 user nova-compute[73068]:   <source dev="/dev/sdd"/>
Aug 26 11:45:57 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:45:57 user nova-compute[73068]:   <serial>7228862b-9cfb-4bb9-9474-820a97139ef7</serial>
Aug 26 11:45:57 user nova-compute[73068]: </disk>
Aug 26 11:45:57 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[468a6fd9-d912-4365-b4cc-1d04f2325c84]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:57 user nova-compute[73068]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:45:57 user nova-compute[73068]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 (non-flash)
Aug 26 11:45:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef (non-flash)
Aug 26 11:45:57 user nova-compute[73068]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:45:57 user nova-compute[73068]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 (non-flash)
Aug 26 11:45:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb0195f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e58dffa-358b-4334-9236-5fc56b2e06d3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4bc2d8-999e-4c83-ac42-df20464628d4]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8960e94f-0ae4-40c8-9dbf-540bbe2846ae]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[520b1bce-7889-4e8d-9f0e-0bee2291b63f]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a6d755-59d5-414b-a33b-5e3c4e9d2c46]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7936c14-c9a0-4f3d-bb92-06cb3253cf3f]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef, portal: 172.16.0.220,3260]
Aug 26 11:45:57 user nova-compute[73068]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef, portal: 172.16.0.220,3260] successful.
Aug 26 11:45:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60472097-b77c-4e15-bb9d-9a81a08850ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[de76820b-0556-44bb-bda3-67174eced2f0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] <== disconnect_volume: return (1132ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.compute.manager [req-6bfb1131-213b-4611-8e2f-615c1a422aa3 req-f4df44bd-702d-4d6b-83ec-0a2904ab5cb9 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6bfb1131-213b-4611-8e2f-615c1a422aa3 req-f4df44bd-702d-4d6b-83ec-0a2904ab5cb9 service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6bfb1131-213b-4611-8e2f-615c1a422aa3 req-f4df44bd-702d-4d6b-83ec-0a2904ab5cb9 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6bfb1131-213b-4611-8e2f-615c1a422aa3 req-f4df44bd-702d-4d6b-83ec-0a2904ab5cb9 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.compute.manager [req-6bfb1131-213b-4611-8e2f-615c1a422aa3 req-f4df44bd-702d-4d6b-83ec-0a2904ab5cb9 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:45:57 user nova-compute[73068]: WARNING nova.compute.manager [req-6bfb1131-213b-4611-8e2f-615c1a422aa3 req-f4df44bd-702d-4d6b-83ec-0a2904ab5cb9 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received unexpected event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with vm_state building and task_state spawning.
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] No VIF found with MAC fa:16:3e:dd:4e:e4, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Skipping network cache update for instance because it is Building. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050357.5493503, 41ef2264-c365-44ee-b4aa-8266e3537c73 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:45:57 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] VM Resumed (Lifecycle Event)
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:45:57 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance spawned successfully.
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid fba812b3-7791-463f-9c86-a51ae7a7457d {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:45:57 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050357.55097, 41ef2264-c365-44ee-b4aa-8266e3537c73 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:45:57 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] VM Started (Lifecycle Event)
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-199476a2-d15c-4553-a86e-4e3e1e45507a tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.545s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:45:57 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:45:57 user nova-compute[73068]: INFO nova.compute.manager [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Took 7.73 seconds to spawn the instance on the hypervisor.
Aug 26 11:45:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:45:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:57 user nova-compute[73068]: INFO nova.compute.manager [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Took 8.65 seconds to build instance.
Aug 26 11:45:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cabba998-d450-4f2b-949f-74cceea1691f tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.760s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Updating instance_info_cache with network_info: [{"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-fba812b3-7791-463f-9c86-a51ae7a7457d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:58 user nova-compute[73068]: INFO nova.compute.manager [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Unshelving
Aug 26 11:45:58 user nova-compute[73068]: INFO nova.virt.block_device [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Booting with volume 56debc60-4388-4f1a-8e65-bd6a2a67c737 at /dev/vdc
Aug 26 11:45:58 user nova-compute[73068]: DEBUG nova.objects.instance [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'flavor' on Instance uuid 79914502-0e07-4b85-abaa-964bc7350f17 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6eb00385-e3a4-4c50-bcb5-cf59201cf361 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.957s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG os_brick.utils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0571a4f2-7115-4c0e-8b2e-36fe23405194]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f00eda-d2c3-4923-af44-008a700c7bb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fee8c2e-03bd-48eb-8221-4c35ef46817e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6b96d6-4018-4293-9427-8ddffb3cb97e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:45:58 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:45:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de1e04a-279f-4581-a77e-f112dde90e8b]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG os_brick.utils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:45:58 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updating existing volume attachment record: 5697cdb9-f3de-41f7-8385-607fc9f73cde {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:45:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "fba812b3-7791-463f-9c86-a51ae7a7457d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:45:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:45:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:45:59 user nova-compute[73068]: INFO nova.compute.manager [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Terminating instance
Aug 26 11:45:59 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:45:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:45:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "e1132a5d-535a-4e72-8d03-25ea977f0034" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:00 user nova-compute[73068]: INFO nova.compute.manager [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Detaching volume 7228862b-9cfb-4bb9-9474-820a97139ef7
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-aad88ce5-ab9f-48a2-acc0-a946758d494a req-e2b5de7b-3810-488e-bb4f-c0b76f913cab service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Received event network-vif-unplugged-d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aad88ce5-ab9f-48a2-acc0-a946758d494a req-e2b5de7b-3810-488e-bb4f-c0b76f913cab service nova] Acquiring lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aad88ce5-ab9f-48a2-acc0-a946758d494a req-e2b5de7b-3810-488e-bb4f-c0b76f913cab service nova] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aad88ce5-ab9f-48a2-acc0-a946758d494a req-e2b5de7b-3810-488e-bb4f-c0b76f913cab service nova] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-aad88ce5-ab9f-48a2-acc0-a946758d494a req-e2b5de7b-3810-488e-bb4f-c0b76f913cab service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] No waiting events found dispatching network-vif-unplugged-d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-aad88ce5-ab9f-48a2-acc0-a946758d494a req-e2b5de7b-3810-488e-bb4f-c0b76f913cab service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Received event network-vif-unplugged-d5258489-ce6e-41e3-b067-cb26bb791c03 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:46:00 user nova-compute[73068]: INFO nova.virt.block_device [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Attempting to driver detach volume 7228862b-9cfb-4bb9-9474-820a97139ef7 from mountpoint /dev/vdb
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Attempting to detach device vdb from instance e1132a5d-535a-4e72-8d03-25ea977f0034 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:46:00 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:46:00 user nova-compute[73068]:   <source dev="/dev/sdd"/>
Aug 26 11:46:00 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:46:00 user nova-compute[73068]:   <serial>7228862b-9cfb-4bb9-9474-820a97139ef7</serial>
Aug 26 11:46:00 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:46:00 user nova-compute[73068]: </disk>
Aug 26 11:46:00 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:46:00 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Successfully detached device vdb from instance e1132a5d-535a-4e72-8d03-25ea977f0034 from the persistent domain config.
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1132a5d-535a-4e72-8d03-25ea977f0034 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:46:00 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:46:00 user nova-compute[73068]:   <source dev="/dev/sdd"/>
Aug 26 11:46:00 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:46:00 user nova-compute[73068]:   <serial>7228862b-9cfb-4bb9-9474-820a97139ef7</serial>
Aug 26 11:46:00 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:46:00 user nova-compute[73068]: </disk>
Aug 26 11:46:00 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:46:00 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Instance destroyed successfully.
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.objects.instance [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lazy-loading 'resources' on Instance uuid fba812b3-7791-463f-9c86-a51ae7a7457d {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1619037140',display_name='tempest-ServersNegativeTestJSON-server-1619037140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1619037140',id=2,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17bdd7cec1d84290be2b2a22a7834b40',ramdisk_id='',reservation_id='r-e6xiv6cd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-41614951',owner_user_name='tempest-ServersNegativeTestJSON-41614951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:37:11Z,user_data=None,user_id='442fddac9e534bbc9d8a5966e6bc3c26',uuid=fba812b3-7791-463f-9c86-a51ae7a7457d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converting VIF {"id": "d5258489-ce6e-41e3-b067-cb26bb791c03", "address": "fa:16:3e:49:3b:4d", "network": {"id": "13d8c66c-9fa9-43ba-b74c-4239d20b3096", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1831041420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17bdd7cec1d84290be2b2a22a7834b40", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5258489-ce", "ovs_interfaceid": "d5258489-ce6e-41e3-b067-cb26bb791c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:3b:4d,bridge_name='br-int',has_traffic_filtering=True,id=d5258489-ce6e-41e3-b067-cb26bb791c03,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5258489-ce') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG os_vif [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:3b:4d,bridge_name='br-int',has_traffic_filtering=True,id=d5258489-ce6e-41e3-b067-cb26bb791c03,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5258489-ce') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5258489-ce, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:00 user nova-compute[73068]: INFO os_vif [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:3b:4d,bridge_name='br-int',has_traffic_filtering=True,id=d5258489-ce6e-41e3-b067-cb26bb791c03,network=Network(13d8c66c-9fa9-43ba-b74c-4239d20b3096),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5258489-ce')
Aug 26 11:46:00 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Deleting instance files /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d_del
Aug 26 11:46:00 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Deletion of /opt/stack/data/nova/instances/fba812b3-7791-463f-9c86-a51ae7a7457d_del complete
Aug 26 11:46:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:00 user nova-compute[73068]: INFO nova.compute.manager [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Took 0.80 seconds to destroy the instance on the hypervisor.
Aug 26 11:46:00 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:46:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050360.997105, e1132a5d-535a-4e72-8d03-25ea977f0034 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1132a5d-535a-4e72-8d03-25ea977f0034 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:46:01 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Successfully detached device vdb from instance e1132a5d-535a-4e72-8d03-25ea977f0034 from the live domain config.
Aug 26 11:46:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SVgtGjPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:46:01 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fcf956-27a4-4eed-82aa-096d574c18b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2277a00d-6126-4ed4-b904-13bdcaa34cf0]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:46:01 user nova-compute[73068]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 (non-flash)
Aug 26 11:46:01 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:46:01 user nova-compute[73068]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 (non-flash)
Aug 26 11:46:01 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd90790160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7'): ({'sdd'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Removing single pathed devices sdd {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985072e-2ac3-4612-966c-c2282fab987b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a1a42f-0e3d-47ac-be8c-ffeecf217ca5]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Flushing IO for device /dev/sdd {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0151a9af-96e6-4c35-97e1-4f7f8d7e0aa1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3996810b-e98f-40ff-b067-a7e873616c94]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e9075f-8ea9-4bbb-bbb3-8c8fe5194033]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c27848-0b71-45c5-b3c4-9d9374ec62b1]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7, portal: 172.16.0.220,3260]
Aug 26 11:46:01 user nova-compute[73068]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7, portal: 172.16.0.220,3260] successful.
Aug 26 11:46:01 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7228862b-9cfb-4bb9-9474-820a97139ef7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aff3cc-1328-48a8-a53c-105d3ec59f38]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] <== disconnect_volume: return (340ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:46:01 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Took 0.70 seconds to deallocate network for instance.
Aug 26 11:46:01 user nova-compute[73068]: DEBUG nova.compute.manager [req-93218e7a-f604-456d-8f63-923b04171a82 req-d6594e3e-259d-4db2-82af-cef0de2b9260 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Received event network-vif-deleted-d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:01 user nova-compute[73068]: INFO nova.compute.manager [req-93218e7a-f604-456d-8f63-923b04171a82 req-d6594e3e-259d-4db2-82af-cef0de2b9260 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Neutron deleted interface d5258489-ce6e-41e3-b067-cb26bb791c03; detaching it from the instance and deleting it from the info cache
Aug 26 11:46:01 user nova-compute[73068]: DEBUG nova.network.neutron [req-93218e7a-f604-456d-8f63-923b04171a82 req-d6594e3e-259d-4db2-82af-cef0de2b9260 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG nova.compute.manager [req-93218e7a-f604-456d-8f63-923b04171a82 req-d6594e3e-259d-4db2-82af-cef0de2b9260 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Detach interface failed, port_id=d5258489-ce6e-41e3-b067-cb26bb791c03, reason: Instance fba812b3-7791-463f-9c86-a51ae7a7457d could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:46:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:02 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Deleted allocations for instance fba812b3-7791-463f-9c86-a51ae7a7457d
Aug 26 11:46:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec93bb7e-a055-4339-901f-0a3f46c46ed6 tempest-ServersNegativeTestJSON-41614951 tempest-ServersNegativeTestJSON-41614951-project-member] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-389e1387-3d48-4c2b-a175-3d3d50374ddf req-361a036c-0acb-4142-938c-86858e664a75 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Received event network-vif-plugged-d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-389e1387-3d48-4c2b-a175-3d3d50374ddf req-361a036c-0acb-4142-938c-86858e664a75 service nova] Acquiring lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-389e1387-3d48-4c2b-a175-3d3d50374ddf req-361a036c-0acb-4142-938c-86858e664a75 service nova] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-389e1387-3d48-4c2b-a175-3d3d50374ddf req-361a036c-0acb-4142-938c-86858e664a75 service nova] Lock "fba812b3-7791-463f-9c86-a51ae7a7457d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-389e1387-3d48-4c2b-a175-3d3d50374ddf req-361a036c-0acb-4142-938c-86858e664a75 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] No waiting events found dispatching network-vif-plugged-d5258489-ce6e-41e3-b067-cb26bb791c03 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:02 user nova-compute[73068]: WARNING nova.compute.manager [req-389e1387-3d48-4c2b-a175-3d3d50374ddf req-361a036c-0acb-4142-938c-86858e664a75 service nova] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Received unexpected event network-vif-plugged-d5258489-ce6e-41e3-b067-cb26bb791c03 for instance with vm_state deleted and task_state None.
Aug 26 11:46:02 user nova-compute[73068]: DEBUG nova.objects.instance [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lazy-loading 'flavor' on Instance uuid e1132a5d-535a-4e72-8d03-25ea977f0034 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-600fc318-f061-4115-bdfe-6e8326e7aa04 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.634s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:11 user nova-compute[73068]: DEBUG nova.objects.instance [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'pci_requests' on Instance uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:11 user nova-compute[73068]: DEBUG nova.objects.instance [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'numa_topology' on Instance uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:46:11 user nova-compute[73068]: INFO nova.compute.claims [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Claim successful on node user
Aug 26 11:46:11 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:46:11 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:46:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:11 user nova-compute[73068]: INFO nova.network.neutron [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updating port c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 11:46:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:46:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquired lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:46:12 user nova-compute[73068]: DEBUG nova.network.neutron [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:46:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-a1697bad-e34a-4f01-80c2-d95b78ff0b8b req-94c8acc2-cb2e-44c8-81f9-3db0cb922fd9 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-changed-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-a1697bad-e34a-4f01-80c2-d95b78ff0b8b req-94c8acc2-cb2e-44c8-81f9-3db0cb922fd9 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Refreshing instance network info cache due to event network-changed-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:46:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a1697bad-e34a-4f01-80c2-d95b78ff0b8b req-94c8acc2-cb2e-44c8-81f9-3db0cb922fd9 service nova] Acquiring lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:46:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updating instance_info_cache with network_info: [{"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Releasing lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:46:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:46:13 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Creating image(s)
Aug 26 11:46:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "/opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "/opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "/opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:13 user nova-compute[73068]: DEBUG nova.objects.instance [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'trusted_certs' on Instance uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a1697bad-e34a-4f01-80c2-d95b78ff0b8b req-94c8acc2-cb2e-44c8-81f9-3db0cb922fd9 service nova] Acquired lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:46:13 user nova-compute[73068]: DEBUG nova.network.neutron [req-a1697bad-e34a-4f01-80c2-d95b78ff0b8b req-94c8acc2-cb2e-44c8-81f9-3db0cb922fd9 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Refreshing network info cache for port c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:46:13 user nova-compute[73068]: DEBUG nova.objects.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Object Instance<a39507fb-9897-4e5d-8217-390785208d52> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:46:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "969d1c1291731c530569f78531d4bf6e2a0d78c8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "969d1c1291731c530569f78531d4bf6e2a0d78c8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8.part --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8.part --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:14 user nova-compute[73068]: DEBUG nova.virt.images [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] 293a6ab3-291a-44eb-8bda-2bdbf7347d3c was qcow2, converting to raw {{(pid=73068) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 11:46:14 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:46:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8.part /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8.converted {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8.part /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8.converted" returned: 0 in 0.346s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8.converted --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG nova.network.neutron [req-a1697bad-e34a-4f01-80c2-d95b78ff0b8b req-94c8acc2-cb2e-44c8-81f9-3db0cb922fd9 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updated VIF entry in instance network info cache for port c0a2f992-3673-45ea-89b4-5f3fa6b65ef6. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG nova.network.neutron [req-a1697bad-e34a-4f01-80c2-d95b78ff0b8b req-94c8acc2-cb2e-44c8-81f9-3db0cb922fd9 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updating instance_info_cache with network_info: [{"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a1697bad-e34a-4f01-80c2-d95b78ff0b8b req-94c8acc2-cb2e-44c8-81f9-3db0cb922fd9 service nova] Releasing lock "refresh_cache-a39507fb-9897-4e5d-8217-390785208d52" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "969d1c1291731c530569f78531d4bf6e2a0d78c8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.991s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8 --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "969d1c1291731c530569f78531d4bf6e2a0d78c8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "969d1c1291731c530569f78531d4bf6e2a0d78c8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8 --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8,backing_fmt=raw /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8,backing_fmt=raw /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk 1073741824" returned: 0 in 0.050s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "969d1c1291731c530569f78531d4bf6e2a0d78c8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050360.5255582, fba812b3-7791-463f-9c86-a51ae7a7457d => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:46:15 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] VM Stopped (Lifecycle Event)
Aug 26 11:46:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-0e0817c9-8f02-4736-9321-43ac19784746 None None] [instance: fba812b3-7791-463f-9c86-a51ae7a7457d] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8 --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG nova.objects.instance [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'migration_context' on Instance uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG nova.objects.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Object Instance<a39507fb-9897-4e5d-8217-390785208d52> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:46:15 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Rebasing disk image.
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 -F raw /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 -F raw /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk" returned: 0 in 2.505s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Ensure instance console log exists: /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Start _get_guest_xml network_info=[{"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e14f1cb61a7bef24c84ccb613231c34e',container_format='bare',created_at=2023-08-26T11:44:05Z,direct_url=<?>,disk_format='qcow2',id=293a6ab3-291a-44eb-8bda-2bdbf7347d3c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1102777405-shelved',owner='96de3b4133bc4201880aba9e21a28a6e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T11:44:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'attachment_id': '5697cdb9-f3de-41f7-8385-607fc9f73cde', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHqkzMlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a39507fb-9897-4e5d-8217-390785208d52', 'attached_at': '', 'detached_at': '', 'volume_id': '56debc60-4388-4f1a-8e65-bd6a2a67c737', 'serial': '56debc60-4388-4f1a-8e65-bd6a2a67c737'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:46:18 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:46:18 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e14f1cb61a7bef24c84ccb613231c34e',container_format='bare',created_at=2023-08-26T11:44:05Z,direct_url=<?>,disk_format='qcow2',id=293a6ab3-291a-44eb-8bda-2bdbf7347d3c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1102777405-shelved',owner='96de3b4133bc4201880aba9e21a28a6e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T11:44:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.objects.instance [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'vcpu_model' on Instance uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.objects.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Object Instance<a39507fb-9897-4e5d-8217-390785208d52> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHqkzMlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:46:18 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:46:18 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:46:18 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260" returned: 21 in 0.084s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8969ef-b0f0-4123-a198-2a7bcc0291ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:46:18 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2764ff14-fb32-4416-875b-917f0ae58a27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737] added
Aug 26 11:46:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6681c6c-6fb8-4ecf-bc0d-5ceb52df7ba5]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[68539104-2128-4ff4-b7b1-86b420b657f4]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OHqkzMlW {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OHqkzMlW" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f3e051-25d9-4053-b635-89c918a21bfa]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OHqkzMlW'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca1bc80-183d-47ff-9c08-be62dd08b6b0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ebb8f7-9950-4039-af4f-170a51ac51cf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:46:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:46:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:46:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c704b4-a04b-481a-8d27-671de5b51d96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737, portal: 172.16.0.220,3260]
Aug 26 11:46:19 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737, portal: 172.16.0.220,3260] successful.
Aug 26 11:46:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8dc921-9491-46c8-b573-d0ce6a5c1608]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[869c3a1d-5c9f-42fa-baf2-3d567d1af3a6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:46:19 user nova-compute[73068]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:46:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:46:19 user nova-compute[73068]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:46:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[41324ecd-d5b2-4a7e-82df-345c23fdd984]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHqkzMlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26633306464306262', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633306464306262', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1102777405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1102777405',id=17,image_ref='293a6ab3-291a-44eb-8bda-2bdbf7347d3c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1963762537',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-uuvfbky6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member',shelved_at='2023-08-26T11:44:09.749213',shelved_host='user',shelved_image_id='293a6ab3-291a-44eb-8bda-2bdbf7347d3c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=a39507fb-9897-4e5d-8217-390785208d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.objects.instance [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'pci_devices' on Instance uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.objects.base [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Object Instance<a39507fb-9897-4e5d-8217-390785208d52> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:46:20 user nova-compute[73068]:   <uuid>a39507fb-9897-4e5d-8217-390785208d52</uuid>
Aug 26 11:46:20 user nova-compute[73068]:   <name>instance-00000011</name>
Aug 26 11:46:20 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:46:20 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:46:20 user nova-compute[73068]:   <metadata>
Aug 26 11:46:20 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:46:20 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:46:20 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1102777405</nova:name>
Aug 26 11:46:20 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:46:18</nova:creationTime>
Aug 26 11:46:20 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:46:20 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:46:20 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:46:20 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:46:20 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:46:20 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:46:20 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:46:20 user nova-compute[73068]:       <nova:owner>
Aug 26 11:46:20 user nova-compute[73068]:         <nova:user uuid="5d8a761bf9474faba69a5ec80149f352">tempest-AttachVolumeShelveTestJSON-273124191-project-member</nova:user>
Aug 26 11:46:20 user nova-compute[73068]:         <nova:project uuid="96de3b4133bc4201880aba9e21a28a6e">tempest-AttachVolumeShelveTestJSON-273124191</nova:project>
Aug 26 11:46:20 user nova-compute[73068]:       </nova:owner>
Aug 26 11:46:20 user nova-compute[73068]:       <nova:root type="image" uuid="293a6ab3-291a-44eb-8bda-2bdbf7347d3c"/>
Aug 26 11:46:20 user nova-compute[73068]:       <nova:ports>
Aug 26 11:46:20 user nova-compute[73068]:         <nova:port uuid="c0a2f992-3673-45ea-89b4-5f3fa6b65ef6">
Aug 26 11:46:20 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 11:46:20 user nova-compute[73068]:         </nova:port>
Aug 26 11:46:20 user nova-compute[73068]:       </nova:ports>
Aug 26 11:46:20 user nova-compute[73068]:     </nova:instance>
Aug 26 11:46:20 user nova-compute[73068]:   </metadata>
Aug 26 11:46:20 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:46:20 user nova-compute[73068]:     <system>
Aug 26 11:46:20 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:46:20 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:46:20 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:46:20 user nova-compute[73068]:       <entry name="serial">a39507fb-9897-4e5d-8217-390785208d52</entry>
Aug 26 11:46:20 user nova-compute[73068]:       <entry name="uuid">a39507fb-9897-4e5d-8217-390785208d52</entry>
Aug 26 11:46:20 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:46:20 user nova-compute[73068]:     </system>
Aug 26 11:46:20 user nova-compute[73068]:   </sysinfo>
Aug 26 11:46:20 user nova-compute[73068]:   <os>
Aug 26 11:46:20 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:46:20 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:46:20 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:46:20 user nova-compute[73068]:   </os>
Aug 26 11:46:20 user nova-compute[73068]:   <features>
Aug 26 11:46:20 user nova-compute[73068]:     <acpi/>
Aug 26 11:46:20 user nova-compute[73068]:     <apic/>
Aug 26 11:46:20 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:46:20 user nova-compute[73068]:   </features>
Aug 26 11:46:20 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:46:20 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:46:20 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:46:20 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:46:20 user nova-compute[73068]:   </clock>
Aug 26 11:46:20 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:46:20 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:46:20 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:46:20 user nova-compute[73068]:   </cpu>
Aug 26 11:46:20 user nova-compute[73068]:   <devices>
Aug 26 11:46:20 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:46:20 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:46:20 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk"/>
Aug 26 11:46:20 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:46:20 user nova-compute[73068]:     </disk>
Aug 26 11:46:20 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:46:20 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:46:20 user nova-compute[73068]:       <source dev="/dev/sdb"/>
Aug 26 11:46:20 user nova-compute[73068]:       <target dev="vdc" bus="virtio"/>
Aug 26 11:46:20 user nova-compute[73068]:       <serial>56debc60-4388-4f1a-8e65-bd6a2a67c737</serial>
Aug 26 11:46:20 user nova-compute[73068]:     </disk>
Aug 26 11:46:20 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:46:20 user nova-compute[73068]:       <mac address="fa:16:3e:14:98:e8"/>
Aug 26 11:46:20 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:46:20 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:46:20 user nova-compute[73068]:       <target dev="tapc0a2f992-36"/>
Aug 26 11:46:20 user nova-compute[73068]:     </interface>
Aug 26 11:46:20 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:46:20 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/console.log" append="off"/>
Aug 26 11:46:20 user nova-compute[73068]:     </serial>
Aug 26 11:46:20 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:46:20 user nova-compute[73068]:     <video>
Aug 26 11:46:20 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:46:20 user nova-compute[73068]:     </video>
Aug 26 11:46:20 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:46:20 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:46:20 user nova-compute[73068]:     </rng>
Aug 26 11:46:20 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:46:20 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:46:20 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:46:20 user nova-compute[73068]:     </memballoon>
Aug 26 11:46:20 user nova-compute[73068]:   </devices>
Aug 26 11:46:20 user nova-compute[73068]: </domain>
Aug 26 11:46:20 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1102777405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1102777405',id=17,image_ref='293a6ab3-291a-44eb-8bda-2bdbf7347d3c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1963762537',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-uuvfbky6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member',shelved_at='2023-08-26T11:44:09.749213',shelved_host='user',shelved_image_id='293a6ab3-291a-44eb-8bda-2bdbf7347d3c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=a39507fb-9897-4e5d-8217-390785208d52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG os_vif [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0a2f992-36, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0a2f992-36, col_values=(('external_ids', {'iface-id': 'c0a2f992-3673-45ea-89b4-5f3fa6b65ef6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:98:e8', 'vm-uuid': 'a39507fb-9897-4e5d-8217-390785208d52'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:20 user nova-compute[73068]: INFO os_vif [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36')
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] No VIF found with MAC fa:16:3e:14:98:e8, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:46:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-f6ca3bec-9836-47d5-a9ee-a907e0511a3f req-e4f88350-37f8-4f3a-a865-fa29592bbb03 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f6ca3bec-9836-47d5-a9ee-a907e0511a3f req-e4f88350-37f8-4f3a-a865-fa29592bbb03 service nova] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f6ca3bec-9836-47d5-a9ee-a907e0511a3f req-e4f88350-37f8-4f3a-a865-fa29592bbb03 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f6ca3bec-9836-47d5-a9ee-a907e0511a3f req-e4f88350-37f8-4f3a-a865-fa29592bbb03 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-f6ca3bec-9836-47d5-a9ee-a907e0511a3f req-e4f88350-37f8-4f3a-a865-fa29592bbb03 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] No waiting events found dispatching network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:22 user nova-compute[73068]: WARNING nova.compute.manager [req-f6ca3bec-9836-47d5-a9ee-a907e0511a3f req-e4f88350-37f8-4f3a-a865-fa29592bbb03 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received unexpected event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 11:46:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-49787bfc-f158-48fe-8495-27121fcf5289 req-1ad241a3-8ae2-41ec-b636-4dc12a89ac82 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-49787bfc-f158-48fe-8495-27121fcf5289 req-1ad241a3-8ae2-41ec-b636-4dc12a89ac82 service nova] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-49787bfc-f158-48fe-8495-27121fcf5289 req-1ad241a3-8ae2-41ec-b636-4dc12a89ac82 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-49787bfc-f158-48fe-8495-27121fcf5289 req-1ad241a3-8ae2-41ec-b636-4dc12a89ac82 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-49787bfc-f158-48fe-8495-27121fcf5289 req-1ad241a3-8ae2-41ec-b636-4dc12a89ac82 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] No waiting events found dispatching network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:24 user nova-compute[73068]: WARNING nova.compute.manager [req-49787bfc-f158-48fe-8495-27121fcf5289 req-1ad241a3-8ae2-41ec-b636-4dc12a89ac82 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received unexpected event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 11:46:24 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050384.3910792, a39507fb-9897-4e5d-8217-390785208d52 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:46:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] VM Resumed (Lifecycle Event)
Aug 26 11:46:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:46:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:46:24 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] Instance spawned successfully.
Aug 26 11:46:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:46:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:46:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:46:24 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050384.3915768, a39507fb-9897-4e5d-8217-390785208d52 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:46:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] VM Started (Lifecycle Event)
Aug 26 11:46:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:46:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:46:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:46:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:46:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-47231410-d266-4064-8fab-7d361779092c tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.506s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Acquiring lock "17331d3e-f9d6-40bd-b68b-4444cf885e48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:46:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:46:28 user nova-compute[73068]: INFO nova.compute.claims [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Claim successful on node user
Aug 26 11:46:28 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:46:28 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:46:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:46:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:46:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:46:28 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:46:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG nova.compute.manager [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:46:29 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Creating image(s)
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Acquiring lock "/opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "/opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "/opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG nova.policy [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cef57755ec14392995b505d7d4808ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b654a353710c4870b5744a2b2a4479ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.470s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk 1073741824" returned: 0 in 0.049s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.239s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Successfully created port: 5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Cannot resize image /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Ensure instance console log exists: /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.network.neutron [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Successfully updated port: 5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Acquiring lock "refresh_cache-17331d3e-f9d6-40bd-b68b-4444cf885e48" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Acquired lock "refresh_cache-17331d3e-f9d6-40bd-b68b-4444cf885e48" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.network.neutron [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-8530bd37-2114-4d3a-9983-ba897d49f631 req-d474c96e-af05-488a-a1e9-bcce52fe9e3c service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Received event network-changed-5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-8530bd37-2114-4d3a-9983-ba897d49f631 req-d474c96e-af05-488a-a1e9-bcce52fe9e3c service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Refreshing instance network info cache due to event network-changed-5135b652-5d3c-427b-aeaf-2b2a38326fa3. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8530bd37-2114-4d3a-9983-ba897d49f631 req-d474c96e-af05-488a-a1e9-bcce52fe9e3c service nova] Acquiring lock "refresh_cache-17331d3e-f9d6-40bd-b68b-4444cf885e48" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.network.neutron [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.network.neutron [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Updating instance_info_cache with network_info: [{"id": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "address": "fa:16:3e:57:f6:f3", "network": {"id": "ca043a60-ba74-4b5d-8c57-af7ab10e981b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88c40a3031b540a29dc52c683b2d1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5135b652-5d", "ovs_interfaceid": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Releasing lock "refresh_cache-17331d3e-f9d6-40bd-b68b-4444cf885e48" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Instance network_info: |[{"id": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "address": "fa:16:3e:57:f6:f3", "network": {"id": "ca043a60-ba74-4b5d-8c57-af7ab10e981b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88c40a3031b540a29dc52c683b2d1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5135b652-5d", "ovs_interfaceid": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8530bd37-2114-4d3a-9983-ba897d49f631 req-d474c96e-af05-488a-a1e9-bcce52fe9e3c service nova] Acquired lock "refresh_cache-17331d3e-f9d6-40bd-b68b-4444cf885e48" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-8530bd37-2114-4d3a-9983-ba897d49f631 req-d474c96e-af05-488a-a1e9-bcce52fe9e3c service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Refreshing network info cache for port 5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Start _get_guest_xml network_info=[{"id": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "address": "fa:16:3e:57:f6:f3", "network": {"id": "ca043a60-ba74-4b5d-8c57-af7ab10e981b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88c40a3031b540a29dc52c683b2d1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5135b652-5d", "ovs_interfaceid": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:46:31 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:46:31 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-649050669',display_name='tempest-VolumesNegativeTest-instance-649050669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-649050669',id=27,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b654a353710c4870b5744a2b2a4479ab',ramdisk_id='',reservation_id='r-9b7sj3fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-750477456',owner_user_name='tempest-VolumesNegativeTest-750477456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:46:29Z,user_data=None,user_id='7cef57755ec14392995b505d7d4808ed',uuid=17331d3e-f9d6-40bd-b68b-4444cf885e48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "address": "fa:16:3e:57:f6:f3", "network": {"id": "ca043a60-ba74-4b5d-8c57-af7ab10e981b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88c40a3031b540a29dc52c683b2d1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5135b652-5d", "ovs_interfaceid": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Converting VIF {"id": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "address": "fa:16:3e:57:f6:f3", "network": {"id": "ca043a60-ba74-4b5d-8c57-af7ab10e981b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88c40a3031b540a29dc52c683b2d1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5135b652-5d", "ovs_interfaceid": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:f6:f3,bridge_name='br-int',has_traffic_filtering=True,id=5135b652-5d3c-427b-aeaf-2b2a38326fa3,network=Network(ca043a60-ba74-4b5d-8c57-af7ab10e981b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5135b652-5d') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.objects.instance [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lazy-loading 'pci_devices' on Instance uuid 17331d3e-f9d6-40bd-b68b-4444cf885e48 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:46:31 user nova-compute[73068]:   <uuid>17331d3e-f9d6-40bd-b68b-4444cf885e48</uuid>
Aug 26 11:46:31 user nova-compute[73068]:   <name>instance-0000001b</name>
Aug 26 11:46:31 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:46:31 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:46:31 user nova-compute[73068]:   <metadata>
Aug 26 11:46:31 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:46:31 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:46:31 user nova-compute[73068]:       <nova:name>tempest-VolumesNegativeTest-instance-649050669</nova:name>
Aug 26 11:46:31 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:46:31</nova:creationTime>
Aug 26 11:46:31 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:46:31 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:46:31 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:46:31 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:46:31 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:46:31 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:46:31 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:46:31 user nova-compute[73068]:       <nova:owner>
Aug 26 11:46:31 user nova-compute[73068]:         <nova:user uuid="7cef57755ec14392995b505d7d4808ed">tempest-VolumesNegativeTest-750477456-project-member</nova:user>
Aug 26 11:46:31 user nova-compute[73068]:         <nova:project uuid="b654a353710c4870b5744a2b2a4479ab">tempest-VolumesNegativeTest-750477456</nova:project>
Aug 26 11:46:31 user nova-compute[73068]:       </nova:owner>
Aug 26 11:46:31 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:46:31 user nova-compute[73068]:       <nova:ports>
Aug 26 11:46:31 user nova-compute[73068]:         <nova:port uuid="5135b652-5d3c-427b-aeaf-2b2a38326fa3">
Aug 26 11:46:31 user nova-compute[73068]:           <nova:ip type="fixed" address="192.168.233.245" ipVersion="4"/>
Aug 26 11:46:31 user nova-compute[73068]:         </nova:port>
Aug 26 11:46:31 user nova-compute[73068]:       </nova:ports>
Aug 26 11:46:31 user nova-compute[73068]:     </nova:instance>
Aug 26 11:46:31 user nova-compute[73068]:   </metadata>
Aug 26 11:46:31 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:46:31 user nova-compute[73068]:     <system>
Aug 26 11:46:31 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:46:31 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:46:31 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:46:31 user nova-compute[73068]:       <entry name="serial">17331d3e-f9d6-40bd-b68b-4444cf885e48</entry>
Aug 26 11:46:31 user nova-compute[73068]:       <entry name="uuid">17331d3e-f9d6-40bd-b68b-4444cf885e48</entry>
Aug 26 11:46:31 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:46:31 user nova-compute[73068]:     </system>
Aug 26 11:46:31 user nova-compute[73068]:   </sysinfo>
Aug 26 11:46:31 user nova-compute[73068]:   <os>
Aug 26 11:46:31 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:46:31 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:46:31 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:46:31 user nova-compute[73068]:   </os>
Aug 26 11:46:31 user nova-compute[73068]:   <features>
Aug 26 11:46:31 user nova-compute[73068]:     <acpi/>
Aug 26 11:46:31 user nova-compute[73068]:     <apic/>
Aug 26 11:46:31 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:46:31 user nova-compute[73068]:   </features>
Aug 26 11:46:31 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:46:31 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:46:31 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:46:31 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:46:31 user nova-compute[73068]:   </clock>
Aug 26 11:46:31 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:46:31 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:46:31 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:46:31 user nova-compute[73068]:   </cpu>
Aug 26 11:46:31 user nova-compute[73068]:   <devices>
Aug 26 11:46:31 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:46:31 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:46:31 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk"/>
Aug 26 11:46:31 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:46:31 user nova-compute[73068]:     </disk>
Aug 26 11:46:31 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:46:31 user nova-compute[73068]:       <mac address="fa:16:3e:57:f6:f3"/>
Aug 26 11:46:31 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:46:31 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:46:31 user nova-compute[73068]:       <target dev="tap5135b652-5d"/>
Aug 26 11:46:31 user nova-compute[73068]:     </interface>
Aug 26 11:46:31 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:46:31 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/console.log" append="off"/>
Aug 26 11:46:31 user nova-compute[73068]:     </serial>
Aug 26 11:46:31 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:46:31 user nova-compute[73068]:     <video>
Aug 26 11:46:31 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:46:31 user nova-compute[73068]:     </video>
Aug 26 11:46:31 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:46:31 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:46:31 user nova-compute[73068]:     </rng>
Aug 26 11:46:31 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:46:31 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:46:31 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:46:31 user nova-compute[73068]:     </memballoon>
Aug 26 11:46:31 user nova-compute[73068]:   </devices>
Aug 26 11:46:31 user nova-compute[73068]: </domain>
Aug 26 11:46:31 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-649050669',display_name='tempest-VolumesNegativeTest-instance-649050669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-649050669',id=27,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b654a353710c4870b5744a2b2a4479ab',ramdisk_id='',reservation_id='r-9b7sj3fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-750477456',owner_user_name='tempest-VolumesNegativeTest-750477456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:46:29Z,user_data=None,user_id='7cef57755ec14392995b505d7d4808ed',uuid=17331d3e-f9d6-40bd-b68b-4444cf885e48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "address": "fa:16:3e:57:f6:f3", "network": {"id": "ca043a60-ba74-4b5d-8c57-af7ab10e981b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88c40a3031b540a29dc52c683b2d1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5135b652-5d", "ovs_interfaceid": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Converting VIF {"id": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "address": "fa:16:3e:57:f6:f3", "network": {"id": "ca043a60-ba74-4b5d-8c57-af7ab10e981b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88c40a3031b540a29dc52c683b2d1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5135b652-5d", "ovs_interfaceid": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:f6:f3,bridge_name='br-int',has_traffic_filtering=True,id=5135b652-5d3c-427b-aeaf-2b2a38326fa3,network=Network(ca043a60-ba74-4b5d-8c57-af7ab10e981b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5135b652-5d') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG os_vif [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:f6:f3,bridge_name='br-int',has_traffic_filtering=True,id=5135b652-5d3c-427b-aeaf-2b2a38326fa3,network=Network(ca043a60-ba74-4b5d-8c57-af7ab10e981b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5135b652-5d') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5135b652-5d, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5135b652-5d, col_values=(('external_ids', {'iface-id': '5135b652-5d3c-427b-aeaf-2b2a38326fa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:f6:f3', 'vm-uuid': '17331d3e-f9d6-40bd-b68b-4444cf885e48'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:31 user nova-compute[73068]: INFO os_vif [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:f6:f3,bridge_name='br-int',has_traffic_filtering=True,id=5135b652-5d3c-427b-aeaf-2b2a38326fa3,network=Network(ca043a60-ba74-4b5d-8c57-af7ab10e981b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5135b652-5d')
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:46:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] No VIF found with MAC fa:16:3e:57:f6:f3, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:46:32 user nova-compute[73068]: DEBUG nova.network.neutron [req-8530bd37-2114-4d3a-9983-ba897d49f631 req-d474c96e-af05-488a-a1e9-bcce52fe9e3c service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Updated VIF entry in instance network info cache for port 5135b652-5d3c-427b-aeaf-2b2a38326fa3. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:46:32 user nova-compute[73068]: DEBUG nova.network.neutron [req-8530bd37-2114-4d3a-9983-ba897d49f631 req-d474c96e-af05-488a-a1e9-bcce52fe9e3c service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Updating instance_info_cache with network_info: [{"id": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "address": "fa:16:3e:57:f6:f3", "network": {"id": "ca043a60-ba74-4b5d-8c57-af7ab10e981b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88c40a3031b540a29dc52c683b2d1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5135b652-5d", "ovs_interfaceid": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8530bd37-2114-4d3a-9983-ba897d49f631 req-d474c96e-af05-488a-a1e9-bcce52fe9e3c service nova] Releasing lock "refresh_cache-17331d3e-f9d6-40bd-b68b-4444cf885e48" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-b9c84c34-8611-4e84-8c78-5d0d4dd4e01f req-03bd5180-d3e8-4825-a3ab-4ce97dbee183 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Received event network-vif-plugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b9c84c34-8611-4e84-8c78-5d0d4dd4e01f req-03bd5180-d3e8-4825-a3ab-4ce97dbee183 service nova] Acquiring lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b9c84c34-8611-4e84-8c78-5d0d4dd4e01f req-03bd5180-d3e8-4825-a3ab-4ce97dbee183 service nova] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b9c84c34-8611-4e84-8c78-5d0d4dd4e01f req-03bd5180-d3e8-4825-a3ab-4ce97dbee183 service nova] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-b9c84c34-8611-4e84-8c78-5d0d4dd4e01f req-03bd5180-d3e8-4825-a3ab-4ce97dbee183 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] No waiting events found dispatching network-vif-plugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:33 user nova-compute[73068]: WARNING nova.compute.manager [req-b9c84c34-8611-4e84-8c78-5d0d4dd4e01f req-03bd5180-d3e8-4825-a3ab-4ce97dbee183 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Received unexpected event network-vif-plugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 for instance with vm_state building and task_state spawning.
Aug 26 11:46:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-e908c09e-5c6d-4d44-ba47-545eb894f2e5 req-9a6a85b0-4baf-49cf-b698-faa5327e947d service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Received event network-changed-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-e908c09e-5c6d-4d44-ba47-545eb894f2e5 req-9a6a85b0-4baf-49cf-b698-faa5327e947d service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Refreshing instance network info cache due to event network-changed-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e908c09e-5c6d-4d44-ba47-545eb894f2e5 req-9a6a85b0-4baf-49cf-b698-faa5327e947d service nova] Acquiring lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e908c09e-5c6d-4d44-ba47-545eb894f2e5 req-9a6a85b0-4baf-49cf-b698-faa5327e947d service nova] Acquired lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:46:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-e908c09e-5c6d-4d44-ba47-545eb894f2e5 req-9a6a85b0-4baf-49cf-b698-faa5327e947d service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Refreshing network info cache for port a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:46:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-e908c09e-5c6d-4d44-ba47-545eb894f2e5 req-9a6a85b0-4baf-49cf-b698-faa5327e947d service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Updated VIF entry in instance network info cache for port a6b9bfc5-4a72-4001-83b8-a2f9d4f83415. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:46:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-e908c09e-5c6d-4d44-ba47-545eb894f2e5 req-9a6a85b0-4baf-49cf-b698-faa5327e947d service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Updating instance_info_cache with network_info: [{"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e908c09e-5c6d-4d44-ba47-545eb894f2e5 req-9a6a85b0-4baf-49cf-b698-faa5327e947d service nova] Releasing lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:46:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-49d5e093-03ef-4606-9f07-378f6d934dbb req-e7e94c93-ed65-404c-9fae-2ba999cc76d1 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Received event network-vif-plugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-49d5e093-03ef-4606-9f07-378f6d934dbb req-e7e94c93-ed65-404c-9fae-2ba999cc76d1 service nova] Acquiring lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-49d5e093-03ef-4606-9f07-378f6d934dbb req-e7e94c93-ed65-404c-9fae-2ba999cc76d1 service nova] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-49d5e093-03ef-4606-9f07-378f6d934dbb req-e7e94c93-ed65-404c-9fae-2ba999cc76d1 service nova] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-49d5e093-03ef-4606-9f07-378f6d934dbb req-e7e94c93-ed65-404c-9fae-2ba999cc76d1 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] No waiting events found dispatching network-vif-plugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:35 user nova-compute[73068]: WARNING nova.compute.manager [req-49d5e093-03ef-4606-9f07-378f6d934dbb req-e7e94c93-ed65-404c-9fae-2ba999cc76d1 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Received unexpected event network-vif-plugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 for instance with vm_state building and task_state spawning.
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:36 user nova-compute[73068]: INFO nova.compute.manager [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Detaching volume df37f7fb-d515-4f53-a2f4-fedeaebe3712
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050396.0900114, 17331d3e-f9d6-40bd-b68b-4444cf885e48 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:46:36 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] VM Resumed (Lifecycle Event)
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:46:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Instance spawned successfully.
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:36 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050396.0924587, 17331d3e-f9d6-40bd-b68b-4444cf885e48 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:46:36 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] VM Started (Lifecycle Event)
Aug 26 11:46:36 user nova-compute[73068]: INFO nova.virt.block_device [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Attempting to driver detach volume df37f7fb-d515-4f53-a2f4-fedeaebe3712 from mountpoint /dev/vdb
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Attempting to detach device vdb from instance 5d0fb227-c825-4fe0-afe4-92f351a70f88 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:46:36 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:46:36 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:46:36 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:46:36 user nova-compute[73068]:   <serial>df37f7fb-d515-4f53-a2f4-fedeaebe3712</serial>
Aug 26 11:46:36 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:46:36 user nova-compute[73068]: </disk>
Aug 26 11:46:36 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:46:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Successfully detached device vdb from instance 5d0fb227-c825-4fe0-afe4-92f351a70f88 from the persistent domain config.
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5d0fb227-c825-4fe0-afe4-92f351a70f88 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:46:36 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:46:36 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:46:36 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:46:36 user nova-compute[73068]:   <serial>df37f7fb-d515-4f53-a2f4-fedeaebe3712</serial>
Aug 26 11:46:36 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:46:36 user nova-compute[73068]: </disk>
Aug 26 11:46:36 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:46:36 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:46:36 user nova-compute[73068]: INFO nova.compute.manager [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Took 7.12 seconds to spawn the instance on the hypervisor.
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:46:36 user nova-compute[73068]: INFO nova.compute.manager [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Took 7.95 seconds to build instance.
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-fb4d5e3f-94d3-4cc7-a7fb-5af4542db98b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.062s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050396.8394618, 5d0fb227-c825-4fe0-afe4-92f351a70f88 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5d0fb227-c825-4fe0-afe4-92f351a70f88 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:46:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Successfully detached device vdb from instance 5d0fb227-c825-4fe0-afe4-92f351a70f88 from the live domain config.
Aug 26 11:46:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZQnKUyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:46:36 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:46:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d531e1fb-fee1-485d-961c-c235e290c6e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d59d54-c489-48ac-9cf3-6605b9cb8560]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:46:36 user nova-compute[73068]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:46:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 (non-flash)
Aug 26 11:46:36 user nova-compute[73068]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:46:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9036b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[347574a9-894f-488f-b29f-57a7b6076df7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdc3f08-844f-4e6f-a564-626541da6501]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77b2b4f-ede7-4081-9e95-6c8203846473]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:46:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c865d6-d186-4b6a-965e-dedef176c956]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ba9f59-3e36-4a9d-b987-b7193b519bf1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0466d4a-e86c-4a6f-98b3-8f12156ff987]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712, portal: 172.16.0.220,3260]
Aug 26 11:46:37 user nova-compute[73068]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712, portal: 172.16.0.220,3260] successful.
Aug 26 11:46:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a718d639-6d4b-4f69-9ad7-87be3cfa2527]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] <== disconnect_volume: return (349ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:46:37 user nova-compute[73068]: INFO nova.compute.claims [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Claim successful on node user
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lazy-loading 'flavor' on Instance uuid 5d0fb227-c825-4fe0-afe4-92f351a70f88 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9b3af674-4b5e-4459-9e83-12b08269a86d tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.193s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.053s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:38 user nova-compute[73068]: INFO nova.compute.manager [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Terminating instance
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:46:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-52c077e9-7783-4351-964f-4c8c433ebb23 req-9ad36433-5bcd-4f9a-8577-01d45d38056b service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Received event network-vif-unplugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-52c077e9-7783-4351-964f-4c8c433ebb23 req-9ad36433-5bcd-4f9a-8577-01d45d38056b service nova] Acquiring lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-52c077e9-7783-4351-964f-4c8c433ebb23 req-9ad36433-5bcd-4f9a-8577-01d45d38056b service nova] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-52c077e9-7783-4351-964f-4c8c433ebb23 req-9ad36433-5bcd-4f9a-8577-01d45d38056b service nova] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-52c077e9-7783-4351-964f-4c8c433ebb23 req-9ad36433-5bcd-4f9a-8577-01d45d38056b service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] No waiting events found dispatching network-vif-unplugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-52c077e9-7783-4351-964f-4c8c433ebb23 req-9ad36433-5bcd-4f9a-8577-01d45d38056b service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Received event network-vif-unplugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.policy [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dbdaab1cbb4446b8709fe4526c10317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b517fdd290f5457f99b6cc9423a809b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:46:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Creating image(s)
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "/opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "/opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "/opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.288s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:39 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Instance destroyed successfully.
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lazy-loading 'resources' on Instance uuid 5d0fb227-c825-4fe0-afe4-92f351a70f88 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:43:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1493654976',display_name='tempest-VolumesSnapshotTestJSON-instance-1493654976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1493654976',id=21,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPxqLhXW92TWX8AU2xbW6UXcq5dmJgvSI2DT6eWHzxjur6NqBKtgf7Sh7mapKhfT1qa1uCBZlUTrvnD4rqHjtd4gA5iAvxgjf4SoCgBcNX2VabASGBzBudQsWwLG9Aedw==',key_name='tempest-keypair-876547754',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:43:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='152ceb72f1e54291a5aacf0a7403e4f0',ramdisk_id='',reservation_id='r-sj5u9882',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1332483418',owner_user_name='tempest-VolumesSnapshotTestJSON-1332483418-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f42e503ca2ad49479def3b68cb51a7b3',uuid=5d0fb227-c825-4fe0-afe4-92f351a70f88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "address": "fa:16:3e:b3:d5:be", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8e3ed4-51", "ovs_interfaceid": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converting VIF {"id": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "address": "fa:16:3e:b3:d5:be", "network": {"id": "7794c1f3-f08e-4954-907b-7014e4f67c5c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1230878010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "152ceb72f1e54291a5aacf0a7403e4f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8e3ed4-51", "ovs_interfaceid": "8b8e3ed4-51d1-4535-ac62-c0d3a1f30479", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d5:be,bridge_name='br-int',has_traffic_filtering=True,id=8b8e3ed4-51d1-4535-ac62-c0d3a1f30479,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8e3ed4-51') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG os_vif [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d5:be,bridge_name='br-int',has_traffic_filtering=True,id=8b8e3ed4-51d1-4535-ac62-c0d3a1f30479,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8e3ed4-51') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b8e3ed4-51, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:39 user nova-compute[73068]: INFO os_vif [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:d5:be,bridge_name='br-int',has_traffic_filtering=True,id=8b8e3ed4-51d1-4535-ac62-c0d3a1f30479,network=Network(7794c1f3-f08e-4954-907b-7014e4f67c5c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8e3ed4-51')
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZQnKUyR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:46:39 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:46:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df37f7fb-d515-4f53-a2f4-fedeaebe3712', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ba83f3-15d3-434c-9e00-b99732e14f08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48f1136-58a1-43a9-a9ff-74573271f6b5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:46:39 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:46:39 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9025a8c0>, {}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Disconnecting from: [] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] <== disconnect_volume: return (57ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:46:39 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Deleting instance files /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88_del
Aug 26 11:46:39 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Deletion of /opt/stack/data/nova/instances/5d0fb227-c825-4fe0-afe4-92f351a70f88_del complete
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.211s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk 1073741824" returned: 0 in 0.059s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:39 user nova-compute[73068]: INFO nova.compute.manager [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Successfully created port: f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.209s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Cannot resize image /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Ensure instance console log exists: /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Successfully updated port: f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "refresh_cache-4695a204-a297-4971-bb38-2229dbba7a06" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquired lock "refresh_cache-4695a204-a297-4971-bb38-2229dbba7a06" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-f1f2c4f2-1f77-4018-b147-395d80e50825 req-0851ee6a-cf2a-402a-8fc9-13ca0f5f09ed service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-changed-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-f1f2c4f2-1f77-4018-b147-395d80e50825 req-0851ee6a-cf2a-402a-8fc9-13ca0f5f09ed service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Refreshing instance network info cache due to event network-changed-f4e85893-b8db-4042-9f14-8b4678f476ed. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f1f2c4f2-1f77-4018-b147-395d80e50825 req-0851ee6a-cf2a-402a-8fc9-13ca0f5f09ed service nova] Acquiring lock "refresh_cache-4695a204-a297-4971-bb38-2229dbba7a06" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-4513433a-fab9-4702-bf2c-854e090ad550 req-8a6f8602-d408-4eb5-97e2-83fe055f0d39 service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Received event network-vif-plugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4513433a-fab9-4702-bf2c-854e090ad550 req-8a6f8602-d408-4eb5-97e2-83fe055f0d39 service nova] Acquiring lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4513433a-fab9-4702-bf2c-854e090ad550 req-8a6f8602-d408-4eb5-97e2-83fe055f0d39 service nova] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4513433a-fab9-4702-bf2c-854e090ad550 req-8a6f8602-d408-4eb5-97e2-83fe055f0d39 service nova] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-4513433a-fab9-4702-bf2c-854e090ad550 req-8a6f8602-d408-4eb5-97e2-83fe055f0d39 service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] No waiting events found dispatching network-vif-plugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:40 user nova-compute[73068]: WARNING nova.compute.manager [req-4513433a-fab9-4702-bf2c-854e090ad550 req-8a6f8602-d408-4eb5-97e2-83fe055f0d39 service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Received unexpected event network-vif-plugged-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 for instance with vm_state active and task_state deleting.
Aug 26 11:46:40 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:40 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Took 1.47 seconds to deallocate network for instance.
Aug 26 11:46:40 user nova-compute[73068]: WARNING nova.volume.cinder [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Attachment 9b8c8d01-551b-462e-a882-6ff5075eb78c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9b8c8d01-551b-462e-a882-6ff5075eb78c. (HTTP 404) (Request-ID: req-fabf5624-50b4-4f5a-8f2f-b0558274da95)
Aug 26 11:46:40 user nova-compute[73068]: INFO nova.compute.manager [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Took 0.02 seconds to detach 1 volumes for instance.
Aug 26 11:46:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Updating instance_info_cache with network_info: [{"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Releasing lock "refresh_cache-4695a204-a297-4971-bb38-2229dbba7a06" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Instance network_info: |[{"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f1f2c4f2-1f77-4018-b147-395d80e50825 req-0851ee6a-cf2a-402a-8fc9-13ca0f5f09ed service nova] Acquired lock "refresh_cache-4695a204-a297-4971-bb38-2229dbba7a06" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-f1f2c4f2-1f77-4018-b147-395d80e50825 req-0851ee6a-cf2a-402a-8fc9-13ca0f5f09ed service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Refreshing network info cache for port f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Start _get_guest_xml network_info=[{"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:46:41 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:46:41 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2027283732',display_name='tempest-tempest.common.compute-instance-2027283732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2027283732',id=28,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNV2C3yebI6gKAGrK2bOsWft5dAyRJojrWxRudnSObcF4K3jO7Gc7ds5KnSPXlJaAeGzxWh/3rn3+GJ58URmNE1RSJWK/aLf+iOgDbE0l7rHOETxDZ6AnrFe8HMnIA0Blw==',key_name='tempest-keypair-540704974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-urrjz1w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=4695a204-a297-4971-bb38-2229dbba7a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.objects.instance [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'pci_devices' on Instance uuid 4695a204-a297-4971-bb38-2229dbba7a06 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:46:41 user nova-compute[73068]:   <uuid>4695a204-a297-4971-bb38-2229dbba7a06</uuid>
Aug 26 11:46:41 user nova-compute[73068]:   <name>instance-0000001c</name>
Aug 26 11:46:41 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:46:41 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:46:41 user nova-compute[73068]:   <metadata>
Aug 26 11:46:41 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:46:41 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:46:41 user nova-compute[73068]:       <nova:name>tempest-tempest.common.compute-instance-2027283732</nova:name>
Aug 26 11:46:41 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:46:41</nova:creationTime>
Aug 26 11:46:41 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:46:41 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:46:41 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:46:41 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:46:41 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:46:41 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:46:41 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:46:41 user nova-compute[73068]:       <nova:owner>
Aug 26 11:46:41 user nova-compute[73068]:         <nova:user uuid="9dbdaab1cbb4446b8709fe4526c10317">tempest-ServerActionsTestOtherA-281587706-project-member</nova:user>
Aug 26 11:46:41 user nova-compute[73068]:         <nova:project uuid="b517fdd290f5457f99b6cc9423a809b5">tempest-ServerActionsTestOtherA-281587706</nova:project>
Aug 26 11:46:41 user nova-compute[73068]:       </nova:owner>
Aug 26 11:46:41 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:46:41 user nova-compute[73068]:       <nova:ports>
Aug 26 11:46:41 user nova-compute[73068]:         <nova:port uuid="f4e85893-b8db-4042-9f14-8b4678f476ed">
Aug 26 11:46:41 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 11:46:41 user nova-compute[73068]:         </nova:port>
Aug 26 11:46:41 user nova-compute[73068]:       </nova:ports>
Aug 26 11:46:41 user nova-compute[73068]:     </nova:instance>
Aug 26 11:46:41 user nova-compute[73068]:   </metadata>
Aug 26 11:46:41 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:46:41 user nova-compute[73068]:     <system>
Aug 26 11:46:41 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:46:41 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:46:41 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:46:41 user nova-compute[73068]:       <entry name="serial">4695a204-a297-4971-bb38-2229dbba7a06</entry>
Aug 26 11:46:41 user nova-compute[73068]:       <entry name="uuid">4695a204-a297-4971-bb38-2229dbba7a06</entry>
Aug 26 11:46:41 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:46:41 user nova-compute[73068]:     </system>
Aug 26 11:46:41 user nova-compute[73068]:   </sysinfo>
Aug 26 11:46:41 user nova-compute[73068]:   <os>
Aug 26 11:46:41 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:46:41 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:46:41 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:46:41 user nova-compute[73068]:   </os>
Aug 26 11:46:41 user nova-compute[73068]:   <features>
Aug 26 11:46:41 user nova-compute[73068]:     <acpi/>
Aug 26 11:46:41 user nova-compute[73068]:     <apic/>
Aug 26 11:46:41 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:46:41 user nova-compute[73068]:   </features>
Aug 26 11:46:41 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:46:41 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:46:41 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:46:41 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:46:41 user nova-compute[73068]:   </clock>
Aug 26 11:46:41 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:46:41 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:46:41 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:46:41 user nova-compute[73068]:   </cpu>
Aug 26 11:46:41 user nova-compute[73068]:   <devices>
Aug 26 11:46:41 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:46:41 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:46:41 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk"/>
Aug 26 11:46:41 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:46:41 user nova-compute[73068]:     </disk>
Aug 26 11:46:41 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:46:41 user nova-compute[73068]:       <mac address="fa:16:3e:ef:4a:ff"/>
Aug 26 11:46:41 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:46:41 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:46:41 user nova-compute[73068]:       <target dev="tapf4e85893-b8"/>
Aug 26 11:46:41 user nova-compute[73068]:     </interface>
Aug 26 11:46:41 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:46:41 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/console.log" append="off"/>
Aug 26 11:46:41 user nova-compute[73068]:     </serial>
Aug 26 11:46:41 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:46:41 user nova-compute[73068]:     <video>
Aug 26 11:46:41 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:46:41 user nova-compute[73068]:     </video>
Aug 26 11:46:41 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:46:41 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:46:41 user nova-compute[73068]:     </rng>
Aug 26 11:46:41 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:46:41 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:46:41 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:46:41 user nova-compute[73068]:     </memballoon>
Aug 26 11:46:41 user nova-compute[73068]:   </devices>
Aug 26 11:46:41 user nova-compute[73068]: </domain>
Aug 26 11:46:41 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2027283732',display_name='tempest-tempest.common.compute-instance-2027283732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2027283732',id=28,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNV2C3yebI6gKAGrK2bOsWft5dAyRJojrWxRudnSObcF4K3jO7Gc7ds5KnSPXlJaAeGzxWh/3rn3+GJ58URmNE1RSJWK/aLf+iOgDbE0l7rHOETxDZ6AnrFe8HMnIA0Blw==',key_name='tempest-keypair-540704974',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-urrjz1w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=4695a204-a297-4971-bb38-2229dbba7a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG os_vif [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4e85893-b8, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4e85893-b8, col_values=(('external_ids', {'iface-id': 'f4e85893-b8db-4042-9f14-8b4678f476ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:4a:ff', 'vm-uuid': '4695a204-a297-4971-bb38-2229dbba7a06'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:41 user nova-compute[73068]: INFO os_vif [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8')
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No VIF found with MAC fa:16:3e:ef:4a:ff, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:41 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Deleted allocations for instance 5d0fb227-c825-4fe0-afe4-92f351a70f88
Aug 26 11:46:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1670be06-0e5c-4cbf-997b-424bf2304b0f tempest-VolumesSnapshotTestJSON-1332483418 tempest-VolumesSnapshotTestJSON-1332483418-project-member] Lock "5d0fb227-c825-4fe0-afe4-92f351a70f88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.247s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-f1f2c4f2-1f77-4018-b147-395d80e50825 req-0851ee6a-cf2a-402a-8fc9-13ca0f5f09ed service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Updated VIF entry in instance network info cache for port f4e85893-b8db-4042-9f14-8b4678f476ed. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-f1f2c4f2-1f77-4018-b147-395d80e50825 req-0851ee6a-cf2a-402a-8fc9-13ca0f5f09ed service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Updating instance_info_cache with network_info: [{"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f1f2c4f2-1f77-4018-b147-395d80e50825 req-0851ee6a-cf2a-402a-8fc9-13ca0f5f09ed service nova] Releasing lock "refresh_cache-4695a204-a297-4971-bb38-2229dbba7a06" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:46:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-510c6138-1c93-4be5-9616-f0138d5f02c1 req-3b788652-3764-4072-be1c-dec19537a940 service nova] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Received event network-vif-deleted-8b8e3ed4-51d1-4535-ac62-c0d3a1f30479 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-aa4da1be-5032-4d0f-8342-caadcb020506 req-0f93ca1e-6b78-45d4-84a1-dc1b5b9ba855 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aa4da1be-5032-4d0f-8342-caadcb020506 req-0f93ca1e-6b78-45d4-84a1-dc1b5b9ba855 service nova] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aa4da1be-5032-4d0f-8342-caadcb020506 req-0f93ca1e-6b78-45d4-84a1-dc1b5b9ba855 service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-aa4da1be-5032-4d0f-8342-caadcb020506 req-0f93ca1e-6b78-45d4-84a1-dc1b5b9ba855 service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-aa4da1be-5032-4d0f-8342-caadcb020506 req-0f93ca1e-6b78-45d4-84a1-dc1b5b9ba855 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] No waiting events found dispatching network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:42 user nova-compute[73068]: WARNING nova.compute.manager [req-aa4da1be-5032-4d0f-8342-caadcb020506 req-0f93ca1e-6b78-45d4-84a1-dc1b5b9ba855 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received unexpected event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed for instance with vm_state building and task_state spawning.
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050404.8836205, 4695a204-a297-4971-bb38-2229dbba7a06 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:46:44 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] VM Resumed (Lifecycle Event)
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:46:44 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Instance spawned successfully.
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:46:44 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050404.8876984, 4695a204-a297-4971-bb38-2229dbba7a06 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:46:44 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] VM Started (Lifecycle Event)
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:46:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:46:44 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:46:45 user nova-compute[73068]: INFO nova.compute.manager [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Took 6.25 seconds to spawn the instance on the hypervisor.
Aug 26 11:46:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-94d0a7cb-8142-4e09-aae3-76f03a37a438 req-47d6ac1e-acb7-4377-8d45-4bec7b575f94 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-94d0a7cb-8142-4e09-aae3-76f03a37a438 req-47d6ac1e-acb7-4377-8d45-4bec7b575f94 service nova] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-94d0a7cb-8142-4e09-aae3-76f03a37a438 req-47d6ac1e-acb7-4377-8d45-4bec7b575f94 service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-94d0a7cb-8142-4e09-aae3-76f03a37a438 req-47d6ac1e-acb7-4377-8d45-4bec7b575f94 service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-94d0a7cb-8142-4e09-aae3-76f03a37a438 req-47d6ac1e-acb7-4377-8d45-4bec7b575f94 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] No waiting events found dispatching network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:45 user nova-compute[73068]: WARNING nova.compute.manager [req-94d0a7cb-8142-4e09-aae3-76f03a37a438 req-47d6ac1e-acb7-4377-8d45-4bec7b575f94 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received unexpected event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed for instance with vm_state building and task_state spawning.
Aug 26 11:46:45 user nova-compute[73068]: INFO nova.compute.manager [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Took 7.28 seconds to build instance.
Aug 26 11:46:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-71527343-9f4e-4f42-b8d2-a4b9a633e5a6 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.464s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "79914502-0e07-4b85-abaa-964bc7350f17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "79914502-0e07-4b85-abaa-964bc7350f17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:45 user nova-compute[73068]: INFO nova.compute.manager [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Terminating instance
Aug 26 11:46:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:46:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-1757e72d-f747-41ae-b363-86b32bcd894a req-9d9fc2bf-6d88-4a0e-a679-045bcf119caa service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Received event network-vif-unplugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1757e72d-f747-41ae-b363-86b32bcd894a req-9d9fc2bf-6d88-4a0e-a679-045bcf119caa service nova] Acquiring lock "79914502-0e07-4b85-abaa-964bc7350f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1757e72d-f747-41ae-b363-86b32bcd894a req-9d9fc2bf-6d88-4a0e-a679-045bcf119caa service nova] Lock "79914502-0e07-4b85-abaa-964bc7350f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1757e72d-f747-41ae-b363-86b32bcd894a req-9d9fc2bf-6d88-4a0e-a679-045bcf119caa service nova] Lock "79914502-0e07-4b85-abaa-964bc7350f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-1757e72d-f747-41ae-b363-86b32bcd894a req-9d9fc2bf-6d88-4a0e-a679-045bcf119caa service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] No waiting events found dispatching network-vif-unplugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-1757e72d-f747-41ae-b363-86b32bcd894a req-9d9fc2bf-6d88-4a0e-a679-045bcf119caa service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Received event network-vif-unplugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:46:46 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Instance destroyed successfully.
Aug 26 11:46:46 user nova-compute[73068]: DEBUG nova.objects.instance [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'resources' on Instance uuid 79914502-0e07-4b85-abaa-964bc7350f17 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1824173188',display_name='tempest-AttachVolumeNegativeTest-server-1824173188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1824173188',id=20,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1Fc5QxcgkBNXdfROp+2q88vYmCcvf2TvScvL0giPWgk3H0bUNxopBV8X0SYWGLUcA0OjX2Yu2Ts+mGk3g91celod3gtQbtK7gfyTNykYNXNYn7lJMjgePnTE6oHLaYhw==',key_name='tempest-keypair-1956548108',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:43:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-pdqhegjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:43:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=79914502-0e07-4b85-abaa-964bc7350f17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "address": "fa:16:3e:7d:00:73", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1858f5b5-9e", "ovs_interfaceid": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "address": "fa:16:3e:7d:00:73", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1858f5b5-9e", "ovs_interfaceid": "1858f5b5-9e7e-45b1-8a55-29dedc5356ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:73,bridge_name='br-int',has_traffic_filtering=True,id=1858f5b5-9e7e-45b1-8a55-29dedc5356ae,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1858f5b5-9e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG os_vif [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:73,bridge_name='br-int',has_traffic_filtering=True,id=1858f5b5-9e7e-45b1-8a55-29dedc5356ae,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1858f5b5-9e') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1858f5b5-9e, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:46 user nova-compute[73068]: INFO os_vif [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:00:73,bridge_name='br-int',has_traffic_filtering=True,id=1858f5b5-9e7e-45b1-8a55-29dedc5356ae,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1858f5b5-9e')
Aug 26 11:46:46 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Deleting instance files /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17_del
Aug 26 11:46:46 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Deletion of /opt/stack/data/nova/instances/79914502-0e07-4b85-abaa-964bc7350f17_del complete
Aug 26 11:46:46 user nova-compute[73068]: INFO nova.compute.manager [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 11:46:46 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:46:46 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:46:47 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:46:47 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:47 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Took 1.15 seconds to deallocate network for instance.
Aug 26 11:46:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-73ac6335-b7b8-4f5d-8a80-46db160dbdeb req-20006802-af67-4c2c-a79c-e6d1c774141a service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Received event network-vif-deleted-1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:47 user nova-compute[73068]: INFO nova.compute.manager [req-73ac6335-b7b8-4f5d-8a80-46db160dbdeb req-20006802-af67-4c2c-a79c-e6d1c774141a service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Neutron deleted interface 1858f5b5-9e7e-45b1-8a55-29dedc5356ae; detaching it from the instance and deleting it from the info cache
Aug 26 11:46:47 user nova-compute[73068]: DEBUG nova.network.neutron [req-73ac6335-b7b8-4f5d-8a80-46db160dbdeb req-20006802-af67-4c2c-a79c-e6d1c774141a service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-73ac6335-b7b8-4f5d-8a80-46db160dbdeb req-20006802-af67-4c2c-a79c-e6d1c774141a service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Detach interface failed, port_id=1858f5b5-9e7e-45b1-8a55-29dedc5356ae, reason: Instance 79914502-0e07-4b85-abaa-964bc7350f17 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-76f6bd53-fd44-4d01-a9c4-3202cdacd21d req-869fce08-3c77-438a-afa2-856da1a7d39c service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Received event network-vif-plugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-76f6bd53-fd44-4d01-a9c4-3202cdacd21d req-869fce08-3c77-438a-afa2-856da1a7d39c service nova] Acquiring lock "79914502-0e07-4b85-abaa-964bc7350f17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-76f6bd53-fd44-4d01-a9c4-3202cdacd21d req-869fce08-3c77-438a-afa2-856da1a7d39c service nova] Lock "79914502-0e07-4b85-abaa-964bc7350f17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-76f6bd53-fd44-4d01-a9c4-3202cdacd21d req-869fce08-3c77-438a-afa2-856da1a7d39c service nova] Lock "79914502-0e07-4b85-abaa-964bc7350f17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-76f6bd53-fd44-4d01-a9c4-3202cdacd21d req-869fce08-3c77-438a-afa2-856da1a7d39c service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] No waiting events found dispatching network-vif-plugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:46:48 user nova-compute[73068]: WARNING nova.compute.manager [req-76f6bd53-fd44-4d01-a9c4-3202cdacd21d req-869fce08-3c77-438a-afa2-856da1a7d39c service nova] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Received unexpected event network-vif-plugged-1858f5b5-9e7e-45b1-8a55-29dedc5356ae for instance with vm_state deleted and task_state None.
Aug 26 11:46:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:46:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:46:48 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Deleted allocations for instance 79914502-0e07-4b85-abaa-964bc7350f17
Aug 26 11:46:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4defcbf5-b1eb-4d0e-93f1-7b94242018b0 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "79914502-0e07-4b85-abaa-964bc7350f17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.716s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:50 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:46:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:51 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:46:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:51 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:46:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:54 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050399.0885565, 5d0fb227-c825-4fe0-afe4-92f351a70f88 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:46:54 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] VM Stopped (Lifecycle Event)
Aug 26 11:46:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:54 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f2a6673f-2b81-401b-ad55-d175b3c4ed22 None None] [instance: 5d0fb227-c825-4fe0-afe4-92f351a70f88] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:46:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:46:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:46:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:56 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:46:56 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7355MB free_disk=25.52029800415039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance e1132a5d-535a-4e72-8d03-25ea977f0034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ffe8d8fe-cc8f-44ab-8b95-5db1772b724d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 1da8ad99-b071-4dad-bda9-d233724bea76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 33e73e10-0c25-4ec2-880e-1aeb155a8256 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 41ef2264-c365-44ee-b4aa-8266e3537c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a39507fb-9897-4e5d-8217-390785208d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 17331d3e-f9d6-40bd-b68b-4444cf885e48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4695a204-a297-4971-bb38-2229dbba7a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:46:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:46:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:46:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:46:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:46:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:46:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:46:58 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:46:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updating instance_info_cache with network_info: [{"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:46:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:46:59 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:46:59 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:46:59 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:46:59 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:47:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:47:00 user nova-compute[73068]: INFO nova.compute.manager [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] instance snapshotting
Aug 26 11:47:01 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Beginning live snapshot process
Aug 26 11:47:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json -f qcow2 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json -f qcow2 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:01 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050406.7027452, 79914502-0e07-4b85-abaa-964bc7350f17 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:47:01 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] VM Stopped (Lifecycle Event)
Aug 26 11:47:01 user nova-compute[73068]: DEBUG nova.compute.manager [None req-0dad2593-c2b5-4fda-892d-00b4d1d6e212 None None] [instance: 79914502-0e07-4b85-abaa-964bc7350f17] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:47:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.248s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpecgycjl1/1f972f5082af41fa8fdd217dafc825dc.delta 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpecgycjl1/1f972f5082af41fa8fdd217dafc825dc.delta 1073741824" returned: 0 in 0.076s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:01 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 11:47:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=73068) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 11:47:03 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:47:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] COPY block job progress, current cursor: 75431936 final cursor: 75563008 {{(pid=73068) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 11:47:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73068) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 11:47:03 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 11:47:04 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:47:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpecgycjl1/1f972f5082af41fa8fdd217dafc825dc.delta /opt/stack/data/nova/instances/snapshots/tmpecgycjl1/1f972f5082af41fa8fdd217dafc825dc {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpecgycjl1/1f972f5082af41fa8fdd217dafc825dc.delta /opt/stack/data/nova/instances/snapshots/tmpecgycjl1/1f972f5082af41fa8fdd217dafc825dc" returned: 0 in 0.569s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:04 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Snapshot extracted, beginning image upload
Aug 26 11:47:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "1da8ad99-b071-4dad-bda9-d233724bea76" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "1da8ad99-b071-4dad-bda9-d233724bea76" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:05 user nova-compute[73068]: DEBUG nova.objects.instance [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lazy-loading 'flavor' on Instance uuid 1da8ad99-b071-4dad-bda9-d233724bea76 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:47:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "1da8ad99-b071-4dad-bda9-d233724bea76" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "1da8ad99-b071-4dad-bda9-d233724bea76" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "1da8ad99-b071-4dad-bda9-d233724bea76" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:06 user nova-compute[73068]: INFO nova.compute.manager [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Attaching volume 11dec185-2922-482f-9279-cc888f30876d to /dev/vdb
Aug 26 11:47:06 user nova-compute[73068]: DEBUG os_brick.utils [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[db138218-1d69-45c2-b125-9770a593f435]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cc73f4-c024-469f-9c5f-e9f7b75e9f98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a4593e-5dcb-4368-9f13-b3db487adfa7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4b7df3-4e42-4402-8cdc-5df8f8ea0e04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:47:06 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3340dea5-0e64-40de-b91b-a615574c9f71]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG os_brick.utils [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Updating existing volume attachment record: b3aba289-ba45-4445-afe3-79cea73c47ec {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "33e73e10-0c25-4ec2-880e-1aeb155a8256" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:06 user nova-compute[73068]: INFO nova.compute.manager [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Terminating instance
Aug 26 11:47:06 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-c99d6107-d12a-413d-8b5a-b93042517195 req-c99c5fac-a715-4414-a162-c5cb6f4c390f service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Received event network-vif-unplugged-501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c99d6107-d12a-413d-8b5a-b93042517195 req-c99c5fac-a715-4414-a162-c5cb6f4c390f service nova] Acquiring lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c99d6107-d12a-413d-8b5a-b93042517195 req-c99c5fac-a715-4414-a162-c5cb6f4c390f service nova] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c99d6107-d12a-413d-8b5a-b93042517195 req-c99c5fac-a715-4414-a162-c5cb6f4c390f service nova] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-c99d6107-d12a-413d-8b5a-b93042517195 req-c99c5fac-a715-4414-a162-c5cb6f4c390f service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] No waiting events found dispatching network-vif-unplugged-501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG nova.compute.manager [req-c99d6107-d12a-413d-8b5a-b93042517195 req-c99c5fac-a715-4414-a162-c5cb6f4c390f service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Received event network-vif-unplugged-501f31dd-bfab-479c-9a3d-edc405210f4f for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:47:07 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Snapshot image upload complete
Aug 26 11:47:07 user nova-compute[73068]: INFO nova.compute.manager [None req-e2252b01-f741-455c-9a4d-d81f70888d97 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Took 6.52 seconds to snapshot the instance on the hypervisor.
Aug 26 11:47:07 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Instance destroyed successfully.
Aug 26 11:47:07 user nova-compute[73068]: DEBUG nova.objects.instance [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lazy-loading 'resources' on Instance uuid 33e73e10-0c25-4ec2-880e-1aeb155a8256 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-742703543',display_name='tempest-VolumesActionsTest-instance-742703543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-742703543',id=25,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:45:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e5eb47d0358f4c5b811b316560a66214',ramdisk_id='',reservation_id='r-bhap5bja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1862177138',owner_user_name='tempest-VolumesActionsTest-1862177138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:45:23Z,user_data=None,user_id='c5ae30c967be457c81a16fdae5b44f18',uuid=33e73e10-0c25-4ec2-880e-1aeb155a8256,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "501f31dd-bfab-479c-9a3d-edc405210f4f", "address": "fa:16:3e:0f:39:a7", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501f31dd-bf", "ovs_interfaceid": "501f31dd-bfab-479c-9a3d-edc405210f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converting VIF {"id": "501f31dd-bfab-479c-9a3d-edc405210f4f", "address": "fa:16:3e:0f:39:a7", "network": {"id": "dcb0962e-8dcf-4661-bbbf-e56c3357241d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-299577096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e5eb47d0358f4c5b811b316560a66214", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap501f31dd-bf", "ovs_interfaceid": "501f31dd-bfab-479c-9a3d-edc405210f4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:39:a7,bridge_name='br-int',has_traffic_filtering=True,id=501f31dd-bfab-479c-9a3d-edc405210f4f,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501f31dd-bf') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG os_vif [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:39:a7,bridge_name='br-int',has_traffic_filtering=True,id=501f31dd-bfab-479c-9a3d-edc405210f4f,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501f31dd-bf') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap501f31dd-bf, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:47:07 user nova-compute[73068]: INFO os_vif [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:39:a7,bridge_name='br-int',has_traffic_filtering=True,id=501f31dd-bfab-479c-9a3d-edc405210f4f,network=Network(dcb0962e-8dcf-4661-bbbf-e56c3357241d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap501f31dd-bf')
Aug 26 11:47:07 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Deleting instance files /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256_del
Aug 26 11:47:07 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Deletion of /opt/stack/data/nova/instances/33e73e10-0c25-4ec2-880e-1aeb155a8256_del complete
Aug 26 11:47:07 user nova-compute[73068]: INFO nova.compute.manager [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 26 11:47:07 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:47:07 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:47:08 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:47:08 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Took 0.68 seconds to deallocate network for instance.
Aug 26 11:47:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-cf4f2db6-2813-4fa9-a0df-addf8494f8e5 req-1fd52803-db56-4f43-805c-24a38dc28907 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Received event network-vif-deleted-501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:08 user nova-compute[73068]: INFO nova.compute.manager [req-cf4f2db6-2813-4fa9-a0df-addf8494f8e5 req-1fd52803-db56-4f43-805c-24a38dc28907 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Neutron deleted interface 501f31dd-bfab-479c-9a3d-edc405210f4f; detaching it from the instance and deleting it from the info cache
Aug 26 11:47:08 user nova-compute[73068]: DEBUG nova.network.neutron [req-cf4f2db6-2813-4fa9-a0df-addf8494f8e5 req-1fd52803-db56-4f43-805c-24a38dc28907 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:47:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-cf4f2db6-2813-4fa9-a0df-addf8494f8e5 req-1fd52803-db56-4f43-805c-24a38dc28907 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Detach interface failed, port_id=501f31dd-bfab-479c-9a3d-edc405210f4f, reason: Instance 33e73e10-0c25-4ec2-880e-1aeb155a8256 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:47:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:08 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:47:08 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:47:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:09 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Deleted allocations for instance 33e73e10-0c25-4ec2-880e-1aeb155a8256
Aug 26 11:47:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-6a0b89ef-f6d2-4ea8-be63-d4292391f931 tempest-VolumesActionsTest-1862177138 tempest-VolumesActionsTest-1862177138-project-member] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:09 user nova-compute[73068]: DEBUG nova.compute.manager [req-50d9c1be-c8c8-4f1c-b93d-1f202cf72b8a req-b23d7224-938e-4175-9ceb-240b03549002 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Received event network-vif-plugged-501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-50d9c1be-c8c8-4f1c-b93d-1f202cf72b8a req-b23d7224-938e-4175-9ceb-240b03549002 service nova] Acquiring lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-50d9c1be-c8c8-4f1c-b93d-1f202cf72b8a req-b23d7224-938e-4175-9ceb-240b03549002 service nova] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-50d9c1be-c8c8-4f1c-b93d-1f202cf72b8a req-b23d7224-938e-4175-9ceb-240b03549002 service nova] Lock "33e73e10-0c25-4ec2-880e-1aeb155a8256-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:09 user nova-compute[73068]: DEBUG nova.compute.manager [req-50d9c1be-c8c8-4f1c-b93d-1f202cf72b8a req-b23d7224-938e-4175-9ceb-240b03549002 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] No waiting events found dispatching network-vif-plugged-501f31dd-bfab-479c-9a3d-edc405210f4f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:47:09 user nova-compute[73068]: WARNING nova.compute.manager [req-50d9c1be-c8c8-4f1c-b93d-1f202cf72b8a req-b23d7224-938e-4175-9ceb-240b03549002 service nova] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Received unexpected event network-vif-plugged-501f31dd-bfab-479c-9a3d-edc405210f4f for instance with vm_state deleted and task_state None.
Aug 26 11:47:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:47:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:10 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:47:10 user nova-compute[73068]: INFO nova.compute.claims [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Claim successful on node user
Aug 26 11:47:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:10 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:47:10 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:47:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:47:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:47:10 user nova-compute[73068]: DEBUG nova.network.neutron [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:47:10 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:47:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:47:11 user nova-compute[73068]: DEBUG nova.policy [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4680b32bdaef44f1a95e94447a9cf3ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83dda8fc35fe4c4e95a5ac4cbbb387bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:47:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:47:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:47:11 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Creating image(s)
Aug 26 11:47:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "/opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "/opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "9233c870ced898382cd80028bde2bcb8206f7940" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "9233c870ced898382cd80028bde2bcb8206f7940" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940.part --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG nova.network.neutron [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Successfully created port: 70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940.part --force-share --output=json" returned: 0 in 0.196s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG nova.virt.images [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] 2a70afd8-34e5-44c3-a1ff-5b4a79beed80 was qcow2, converting to raw {{(pid=73068) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940.part /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940.converted {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940.part /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940.converted" returned: 0 in 0.241s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940.converted --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "9233c870ced898382cd80028bde2bcb8206f7940" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.629s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940 --force-share --output=json" returned: 0 in 0.208s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "9233c870ced898382cd80028bde2bcb8206f7940" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "9233c870ced898382cd80028bde2bcb8206f7940" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Successfully updated port: 70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquired lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-20d90de0-6b33-4da5-9faf-bfb42d602fd4 req-7f88f4f1-bf0d-4500-8c1f-3b06cea629b6 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received event network-changed-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-20d90de0-6b33-4da5-9faf-bfb42d602fd4 req-7f88f4f1-bf0d-4500-8c1f-3b06cea629b6 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Refreshing instance network info cache due to event network-changed-70dde5da-ec16-46da-a306-6adc396d5e7a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-20d90de0-6b33-4da5-9faf-bfb42d602fd4 req-7f88f4f1-bf0d-4500-8c1f-3b06cea629b6 service nova] Acquiring lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940 --force-share --output=json" returned: 0 in 0.210s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940,backing_fmt=raw /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940,backing_fmt=raw /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk 1073741824" returned: 0 in 0.054s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "9233c870ced898382cd80028bde2bcb8206f7940" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940 --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Ensure instance console log exists: /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Updating instance_info_cache with network_info: [{"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Releasing lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:47:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Instance network_info: |[{"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-20d90de0-6b33-4da5-9faf-bfb42d602fd4 req-7f88f4f1-bf0d-4500-8c1f-3b06cea629b6 service nova] Acquired lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-20d90de0-6b33-4da5-9faf-bfb42d602fd4 req-7f88f4f1-bf0d-4500-8c1f-3b06cea629b6 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Refreshing network info cache for port 70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Start _get_guest_xml network_info=[{"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b693c6d29dca9684baddff0469bf627e',container_format='bare',created_at=2023-08-26T11:47:01Z,direct_url=<?>,disk_format='qcow2',id=2a70afd8-34e5-44c3-a1ff-5b4a79beed80,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-856975491',owner='83dda8fc35fe4c4e95a5ac4cbbb387bf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T11:47:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '2a70afd8-34e5-44c3-a1ff-5b4a79beed80'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:47:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:47:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b693c6d29dca9684baddff0469bf627e',container_format='bare',created_at=2023-08-26T11:47:01Z,direct_url=<?>,disk_format='qcow2',id=2a70afd8-34e5-44c3-a1ff-5b4a79beed80,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-856975491',owner='83dda8fc35fe4c4e95a5ac4cbbb387bf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T11:47:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1243241120',display_name='tempest-TestStampPattern-server-1243241120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1243241120',id=29,image_ref='2a70afd8-34e5-44c3-a1ff-5b4a79beed80',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOjIwqwXxhj4vuR2faSe2o8BRRzkGgGBvS9L7RYqQe1LIPQbk27huMlBAllDlAQDoNhcMEO2Wm63f3TZ8pj6Qh31l00NncZ1Xwq8mt78Mf8ZGjfLHAOGzP1lCwxVTzSgw==',key_name='tempest-TestStampPattern-1601462936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83dda8fc35fe4c4e95a5ac4cbbb387bf',ramdisk_id='',reservation_id='r-cueikmxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e1132a5d-535a-4e72-8d03-25ea977f0034',image_min_disk='1',image_min_ram='0',image_owner_id='83dda8fc35fe4c4e95a5ac4cbbb387bf',image_owner_project_name='tempest-TestStampPattern-2020058093',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2020058093-project-member',image_user_id='4680b32bdaef44f1a95e94447a9cf3ba',network_allocated='True',owner_project_name='tempest-TestStampPattern-2020058093',owner_user_name='tempest-TestStampPattern-2020058093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:47:11Z,user_data=None,user_id='4680b32bdaef44f1a95e94447a9cf3ba',uuid=8f7236c5-6af7-4f5e-9598-f712ecff61bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converting VIF {"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4e:82,bridge_name='br-int',has_traffic_filtering=True,id=70dde5da-ec16-46da-a306-6adc396d5e7a,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dde5da-ec') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.objects.instance [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f7236c5-6af7-4f5e-9598-f712ecff61bf {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:47:14 user nova-compute[73068]:   <uuid>8f7236c5-6af7-4f5e-9598-f712ecff61bf</uuid>
Aug 26 11:47:14 user nova-compute[73068]:   <name>instance-0000001d</name>
Aug 26 11:47:14 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:47:14 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:47:14 user nova-compute[73068]:   <metadata>
Aug 26 11:47:14 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:47:14 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:47:14 user nova-compute[73068]:       <nova:name>tempest-TestStampPattern-server-1243241120</nova:name>
Aug 26 11:47:14 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:47:14</nova:creationTime>
Aug 26 11:47:14 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:47:14 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:47:14 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:47:14 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:47:14 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:47:14 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:47:14 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:47:14 user nova-compute[73068]:       <nova:owner>
Aug 26 11:47:14 user nova-compute[73068]:         <nova:user uuid="4680b32bdaef44f1a95e94447a9cf3ba">tempest-TestStampPattern-2020058093-project-member</nova:user>
Aug 26 11:47:14 user nova-compute[73068]:         <nova:project uuid="83dda8fc35fe4c4e95a5ac4cbbb387bf">tempest-TestStampPattern-2020058093</nova:project>
Aug 26 11:47:14 user nova-compute[73068]:       </nova:owner>
Aug 26 11:47:14 user nova-compute[73068]:       <nova:root type="image" uuid="2a70afd8-34e5-44c3-a1ff-5b4a79beed80"/>
Aug 26 11:47:14 user nova-compute[73068]:       <nova:ports>
Aug 26 11:47:14 user nova-compute[73068]:         <nova:port uuid="70dde5da-ec16-46da-a306-6adc396d5e7a">
Aug 26 11:47:14 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 11:47:14 user nova-compute[73068]:         </nova:port>
Aug 26 11:47:14 user nova-compute[73068]:       </nova:ports>
Aug 26 11:47:14 user nova-compute[73068]:     </nova:instance>
Aug 26 11:47:14 user nova-compute[73068]:   </metadata>
Aug 26 11:47:14 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:47:14 user nova-compute[73068]:     <system>
Aug 26 11:47:14 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:47:14 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:47:14 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:47:14 user nova-compute[73068]:       <entry name="serial">8f7236c5-6af7-4f5e-9598-f712ecff61bf</entry>
Aug 26 11:47:14 user nova-compute[73068]:       <entry name="uuid">8f7236c5-6af7-4f5e-9598-f712ecff61bf</entry>
Aug 26 11:47:14 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:47:14 user nova-compute[73068]:     </system>
Aug 26 11:47:14 user nova-compute[73068]:   </sysinfo>
Aug 26 11:47:14 user nova-compute[73068]:   <os>
Aug 26 11:47:14 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:47:14 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:47:14 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:47:14 user nova-compute[73068]:   </os>
Aug 26 11:47:14 user nova-compute[73068]:   <features>
Aug 26 11:47:14 user nova-compute[73068]:     <acpi/>
Aug 26 11:47:14 user nova-compute[73068]:     <apic/>
Aug 26 11:47:14 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:47:14 user nova-compute[73068]:   </features>
Aug 26 11:47:14 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:47:14 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:47:14 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:47:14 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:47:14 user nova-compute[73068]:   </clock>
Aug 26 11:47:14 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:47:14 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:47:14 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:47:14 user nova-compute[73068]:   </cpu>
Aug 26 11:47:14 user nova-compute[73068]:   <devices>
Aug 26 11:47:14 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:47:14 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:47:14 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk"/>
Aug 26 11:47:14 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:47:14 user nova-compute[73068]:     </disk>
Aug 26 11:47:14 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:47:14 user nova-compute[73068]:       <mac address="fa:16:3e:8f:4e:82"/>
Aug 26 11:47:14 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:47:14 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:47:14 user nova-compute[73068]:       <target dev="tap70dde5da-ec"/>
Aug 26 11:47:14 user nova-compute[73068]:     </interface>
Aug 26 11:47:14 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:47:14 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/console.log" append="off"/>
Aug 26 11:47:14 user nova-compute[73068]:     </serial>
Aug 26 11:47:14 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:47:14 user nova-compute[73068]:     <video>
Aug 26 11:47:14 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:47:14 user nova-compute[73068]:     </video>
Aug 26 11:47:14 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:47:14 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:47:14 user nova-compute[73068]:     </rng>
Aug 26 11:47:14 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:47:14 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:47:14 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:47:14 user nova-compute[73068]:     </memballoon>
Aug 26 11:47:14 user nova-compute[73068]:   </devices>
Aug 26 11:47:14 user nova-compute[73068]: </domain>
Aug 26 11:47:14 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1243241120',display_name='tempest-TestStampPattern-server-1243241120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1243241120',id=29,image_ref='2a70afd8-34e5-44c3-a1ff-5b4a79beed80',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOjIwqwXxhj4vuR2faSe2o8BRRzkGgGBvS9L7RYqQe1LIPQbk27huMlBAllDlAQDoNhcMEO2Wm63f3TZ8pj6Qh31l00NncZ1Xwq8mt78Mf8ZGjfLHAOGzP1lCwxVTzSgw==',key_name='tempest-TestStampPattern-1601462936',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83dda8fc35fe4c4e95a5ac4cbbb387bf',ramdisk_id='',reservation_id='r-cueikmxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e1132a5d-535a-4e72-8d03-25ea977f0034',image_min_disk='1',image_min_ram='0',image_owner_id='83dda8fc35fe4c4e95a5ac4cbbb387bf',image_owner_project_name='tempest-TestStampPattern-2020058093',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2020058093-project-member',image_user_id='4680b32bdaef44f1a95e94447a9cf3ba',network_allocated='True',owner_project_name='tempest-TestStampPattern-2020058093',owner_user_name='tempest-TestStampPattern-2020058093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:47:11Z,user_data=None,user_id='4680b32bdaef44f1a95e94447a9cf3ba',uuid=8f7236c5-6af7-4f5e-9598-f712ecff61bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converting VIF {"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4e:82,bridge_name='br-int',has_traffic_filtering=True,id=70dde5da-ec16-46da-a306-6adc396d5e7a,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dde5da-ec') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG os_vif [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4e:82,bridge_name='br-int',has_traffic_filtering=True,id=70dde5da-ec16-46da-a306-6adc396d5e7a,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dde5da-ec') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70dde5da-ec, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70dde5da-ec, col_values=(('external_ids', {'iface-id': '70dde5da-ec16-46da-a306-6adc396d5e7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:4e:82', 'vm-uuid': '8f7236c5-6af7-4f5e-9598-f712ecff61bf'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:14 user nova-compute[73068]: INFO os_vif [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4e:82,bridge_name='br-int',has_traffic_filtering=True,id=70dde5da-ec16-46da-a306-6adc396d5e7a,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dde5da-ec')
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] No VIF found with MAC fa:16:3e:8f:4e:82, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-20d90de0-6b33-4da5-9faf-bfb42d602fd4 req-7f88f4f1-bf0d-4500-8c1f-3b06cea629b6 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Updated VIF entry in instance network info cache for port 70dde5da-ec16-46da-a306-6adc396d5e7a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-20d90de0-6b33-4da5-9faf-bfb42d602fd4 req-7f88f4f1-bf0d-4500-8c1f-3b06cea629b6 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Updating instance_info_cache with network_info: [{"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:47:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-20d90de0-6b33-4da5-9faf-bfb42d602fd4 req-7f88f4f1-bf0d-4500-8c1f-3b06cea629b6 service nova] Releasing lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:47:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-403afcdd-a075-43a3-9c75-fdf99fc4c220 req-27a3cb93-21d2-4c02-92e9-77ddad4d87d3 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received event network-vif-plugged-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-403afcdd-a075-43a3-9c75-fdf99fc4c220 req-27a3cb93-21d2-4c02-92e9-77ddad4d87d3 service nova] Acquiring lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-403afcdd-a075-43a3-9c75-fdf99fc4c220 req-27a3cb93-21d2-4c02-92e9-77ddad4d87d3 service nova] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-403afcdd-a075-43a3-9c75-fdf99fc4c220 req-27a3cb93-21d2-4c02-92e9-77ddad4d87d3 service nova] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-403afcdd-a075-43a3-9c75-fdf99fc4c220 req-27a3cb93-21d2-4c02-92e9-77ddad4d87d3 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] No waiting events found dispatching network-vif-plugged-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:47:15 user nova-compute[73068]: WARNING nova.compute.manager [req-403afcdd-a075-43a3-9c75-fdf99fc4c220 req-27a3cb93-21d2-4c02-92e9-77ddad4d87d3 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received unexpected event network-vif-plugged-70dde5da-ec16-46da-a306-6adc396d5e7a for instance with vm_state building and task_state spawning.
Aug 26 11:47:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050438.0111945, 8f7236c5-6af7-4f5e-9598-f712ecff61bf => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:47:18 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] VM Resumed (Lifecycle Event)
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-d7263144-7e56-444a-af25-bb6be37ec567 req-d14535f5-6770-409e-a172-58ae35516094 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received event network-vif-plugged-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d7263144-7e56-444a-af25-bb6be37ec567 req-d14535f5-6770-409e-a172-58ae35516094 service nova] Acquiring lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d7263144-7e56-444a-af25-bb6be37ec567 req-d14535f5-6770-409e-a172-58ae35516094 service nova] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d7263144-7e56-444a-af25-bb6be37ec567 req-d14535f5-6770-409e-a172-58ae35516094 service nova] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-d7263144-7e56-444a-af25-bb6be37ec567 req-d14535f5-6770-409e-a172-58ae35516094 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] No waiting events found dispatching network-vif-plugged-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:47:18 user nova-compute[73068]: WARNING nova.compute.manager [req-d7263144-7e56-444a-af25-bb6be37ec567 req-d14535f5-6770-409e-a172-58ae35516094 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received unexpected event network-vif-plugged-70dde5da-ec16-46da-a306-6adc396d5e7a for instance with vm_state building and task_state spawning.
Aug 26 11:47:18 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Instance spawned successfully.
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:47:18 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050438.016465, 8f7236c5-6af7-4f5e-9598-f712ecff61bf => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:47:18 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] VM Started (Lifecycle Event)
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:47:18 user nova-compute[73068]: INFO nova.compute.manager [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Took 7.05 seconds to spawn the instance on the hypervisor.
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:47:18 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:47:18 user nova-compute[73068]: INFO nova.compute.manager [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Took 7.91 seconds to build instance.
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-06a11db0-af4a-49d2-9e6f-71ecbfcda751 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.027s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTobvHBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:47:18 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:47:18 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:47:18 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8eaf2e-f12a-447b-88d4-f3be8df23254]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:47:18 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[06038ab0-9919-4297-808e-467e7d020f69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d] added
Aug 26 11:47:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[70479d01-0171-46b4-b5b2-e61489c1b9b7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[246bb41b-99f4-4c78-ba15-f271ef85fa53]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTobvHBl {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTobvHBl" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acf3238-3988-4693-a3c8-f502affa989e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wTobvHBl'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac31fba2-2960-42fe-aa96-83681e606130]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2e25de-92c1-454a-81fd-ee555390c91a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:47:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:47:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[51663097-13de-4266-9874-b5a6a00395eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d, portal: 172.16.0.220,3260]
Aug 26 11:47:18 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d, portal: 172.16.0.220,3260] successful.
Aug 26 11:47:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3bfc6b-acf8-42db-b20d-232c159d1da1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50242e01-cb9e-4c58-9a52-6969954f07c2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:47:18 user nova-compute[73068]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d (non-flash)
Aug 26 11:47:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:47:18 user nova-compute[73068]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d (non-flash)
Aug 26 11:47:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ee22cf-d8ad-4b42-b050-2217c8a0d519]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:47:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTobvHBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:47:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:47:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23865623264613031', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:47:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865623264613031', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:47:19 user nova-compute[73068]: DEBUG nova.objects.instance [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lazy-loading 'flavor' on Instance uuid 1da8ad99-b071-4dad-bda9-d233724bea76 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:47:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:47:19 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:47:19 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:47:19 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:47:19 user nova-compute[73068]:   <serial>11dec185-2922-482f-9279-cc888f30876d</serial>
Aug 26 11:47:19 user nova-compute[73068]: </disk>
Aug 26 11:47:19 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:47:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:47:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:47:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] No VIF found with MAC fa:16:3e:64:92:72, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:47:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-be566911-df4a-498e-b605-41a2f311ee97 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "1da8ad99-b071-4dad-bda9-d233724bea76" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.350s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "1da8ad99-b071-4dad-bda9-d233724bea76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "1da8ad99-b071-4dad-bda9-d233724bea76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:21 user nova-compute[73068]: INFO nova.compute.manager [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Terminating instance
Aug 26 11:47:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:47:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-d65e2611-4b37-4203-8741-70f38240546b req-1616b57c-a7d1-4089-a6a6-6004961e63d9 service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Received event network-vif-unplugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d65e2611-4b37-4203-8741-70f38240546b req-1616b57c-a7d1-4089-a6a6-6004961e63d9 service nova] Acquiring lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d65e2611-4b37-4203-8741-70f38240546b req-1616b57c-a7d1-4089-a6a6-6004961e63d9 service nova] Lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d65e2611-4b37-4203-8741-70f38240546b req-1616b57c-a7d1-4089-a6a6-6004961e63d9 service nova] Lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-d65e2611-4b37-4203-8741-70f38240546b req-1616b57c-a7d1-4089-a6a6-6004961e63d9 service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] No waiting events found dispatching network-vif-unplugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-d65e2611-4b37-4203-8741-70f38240546b req-1616b57c-a7d1-4089-a6a6-6004961e63d9 service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Received event network-vif-unplugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:47:22 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Instance destroyed successfully.
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.objects.instance [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lazy-loading 'resources' on Instance uuid 1da8ad99-b071-4dad-bda9-d233724bea76 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-393932001',display_name='tempest-DeleteServersTestJSON-server-393932001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-393932001',id=24,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:45:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6bfa128ef954ce8babddf3df43f17ff',ramdisk_id='',reservation_id='r-d0w7weuu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1219747419',owner_user_name='tempest-DeleteServersTestJSON-1219747419-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:45:18Z,user_data=None,user_id='5267971a93074e2f86ab0ef72a85cddc',uuid=1da8ad99-b071-4dad-bda9-d233724bea76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "address": "fa:16:3e:64:92:72", "network": {"id": "6c9deedf-7371-4bd7-8ede-d8338eb4ddc4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1560996994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6bfa128ef954ce8babddf3df43f17ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20176e83-b4", "ovs_interfaceid": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Converting VIF {"id": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "address": "fa:16:3e:64:92:72", "network": {"id": "6c9deedf-7371-4bd7-8ede-d8338eb4ddc4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1560996994-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6bfa128ef954ce8babddf3df43f17ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20176e83-b4", "ovs_interfaceid": "20176e83-b44b-4bdb-b8ec-ec706a5eab10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:92:72,bridge_name='br-int',has_traffic_filtering=True,id=20176e83-b44b-4bdb-b8ec-ec706a5eab10,network=Network(6c9deedf-7371-4bd7-8ede-d8338eb4ddc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20176e83-b4') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_vif [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:92:72,bridge_name='br-int',has_traffic_filtering=True,id=20176e83-b44b-4bdb-b8ec-ec706a5eab10,network=Network(6c9deedf-7371-4bd7-8ede-d8338eb4ddc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20176e83-b4') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20176e83-b4, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:47:22 user nova-compute[73068]: INFO os_vif [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:92:72,bridge_name='br-int',has_traffic_filtering=True,id=20176e83-b44b-4bdb-b8ec-ec706a5eab10,network=Network(6c9deedf-7371-4bd7-8ede-d8338eb4ddc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20176e83-b4')
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTobvHBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:47:22 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e7ffaa-0f2d-4f7a-9aee-b16ff2a779fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[251e10d8-74ac-45e1-b3f9-838dd4419add]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:47:22 user nova-compute[73068]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d (non-flash)
Aug 26 11:47:22 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:47:22 user nova-compute[73068]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d (non-flash)
Aug 26 11:47:22 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd90399e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d33c48e-f9d0-46d8-8648-76f0997e5a41]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f800700-7472-40b2-b452-5bec074846db]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9287d6be-f831-496c-a46b-8b03645db625]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0329b8-86e8-4e02-92e4-f50423da2087]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc608769-3a61-436f-acec-9c7903e7727c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050427.6599884, 33e73e10-0c25-4ec2-880e-1aeb155a8256 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:47:22 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] VM Stopped (Lifecycle Event)
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c312e6-1ce3-4237-9889-520ff7496c73]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d, portal: 172.16.0.220,3260]
Aug 26 11:47:22 user nova-compute[73068]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d, portal: 172.16.0.220,3260] successful.
Aug 26 11:47:22 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-81a62e44-ac71-4b07-98e8-c42f654df488 None None] [instance: 33e73e10-0c25-4ec2-880e-1aeb155a8256] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11dec185-2922-482f-9279-cc888f30876d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[592ede64-c793-43b4-a07a-4b41fed6196a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] <== disconnect_volume: return (306ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:47:22 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Deleting instance files /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76_del
Aug 26 11:47:22 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Deletion of /opt/stack/data/nova/instances/1da8ad99-b071-4dad-bda9-d233724bea76_del complete
Aug 26 11:47:22 user nova-compute[73068]: INFO nova.compute.manager [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 26 11:47:22 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:47:22 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:47:23 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:47:23 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Took 0.61 seconds to deallocate network for instance.
Aug 26 11:47:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-820ab4b2-76c1-4c81-819a-87b3026ac389 req-1043586b-d3f3-49fd-9afe-a2ec6425b3ce service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Received event network-vif-deleted-20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-9c8dd9f7-03b6-4ce1-baa2-ca598e1d5037 req-0c594dd2-2971-445f-a8e0-b3fee44a1e6e service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Received event network-vif-plugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9c8dd9f7-03b6-4ce1-baa2-ca598e1d5037 req-0c594dd2-2971-445f-a8e0-b3fee44a1e6e service nova] Acquiring lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9c8dd9f7-03b6-4ce1-baa2-ca598e1d5037 req-0c594dd2-2971-445f-a8e0-b3fee44a1e6e service nova] Lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9c8dd9f7-03b6-4ce1-baa2-ca598e1d5037 req-0c594dd2-2971-445f-a8e0-b3fee44a1e6e service nova] Lock "1da8ad99-b071-4dad-bda9-d233724bea76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-9c8dd9f7-03b6-4ce1-baa2-ca598e1d5037 req-0c594dd2-2971-445f-a8e0-b3fee44a1e6e service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] No waiting events found dispatching network-vif-plugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:47:24 user nova-compute[73068]: WARNING nova.compute.manager [req-9c8dd9f7-03b6-4ce1-baa2-ca598e1d5037 req-0c594dd2-2971-445f-a8e0-b3fee44a1e6e service nova] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Received unexpected event network-vif-plugged-20176e83-b44b-4bdb-b8ec-ec706a5eab10 for instance with vm_state active and task_state deleting.
Aug 26 11:47:24 user nova-compute[73068]: INFO nova.compute.manager [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Took 0.81 seconds to detach 1 volumes for instance.
Aug 26 11:47:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:24 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:47:24 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:47:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:24 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Deleted allocations for instance 1da8ad99-b071-4dad-bda9-d233724bea76
Aug 26 11:47:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-771f41dc-7087-4d1d-96d2-57fff4e8c368 tempest-DeleteServersTestJSON-1219747419 tempest-DeleteServersTestJSON-1219747419-project-member] Lock "1da8ad99-b071-4dad-bda9-d233724bea76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.239s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:47:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:47:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:47:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:47:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:37 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050442.3387568, 1da8ad99-b071-4dad-bda9-d233724bea76 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:47:37 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] VM Stopped (Lifecycle Event)
Aug 26 11:47:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-38b88497-da8d-40de-889f-146a27d8773b None None] [instance: 1da8ad99-b071-4dad-bda9-d233724bea76] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:47:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:47:40 user nova-compute[73068]: INFO nova.compute.claims [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Claim successful on node user
Aug 26 11:47:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-c2458095-ed64-4585-ab3d-ea9380276143 req-a46fdaf2-fa23-44fe-a4e2-ca432c882b68 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-changed-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-c2458095-ed64-4585-ab3d-ea9380276143 req-a46fdaf2-fa23-44fe-a4e2-ca432c882b68 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Refreshing instance network info cache due to event network-changed-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c2458095-ed64-4585-ab3d-ea9380276143 req-a46fdaf2-fa23-44fe-a4e2-ca432c882b68 service nova] Acquiring lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c2458095-ed64-4585-ab3d-ea9380276143 req-a46fdaf2-fa23-44fe-a4e2-ca432c882b68 service nova] Acquired lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG nova.network.neutron [req-c2458095-ed64-4585-ab3d-ea9380276143 req-a46fdaf2-fa23-44fe-a4e2-ca432c882b68 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Refreshing network info cache for port 33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:47:40 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG nova.network.neutron [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:47:41 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:47:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG nova.policy [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '613022b47a2e40ca949864fa83fa2e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770f7f84d7714f8d94971cae316c2215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:47:41 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Creating image(s)
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "/opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "/opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-c2458095-ed64-4585-ab3d-ea9380276143 req-a46fdaf2-fa23-44fe-a4e2-ca432c882b68 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Updated VIF entry in instance network info cache for port 33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-c2458095-ed64-4585-ab3d-ea9380276143 req-a46fdaf2-fa23-44fe-a4e2-ca432c882b68 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Updating instance_info_cache with network_info: [{"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c2458095-ed64-4585-ab3d-ea9380276143 req-a46fdaf2-fa23-44fe-a4e2-ca432c882b68 service nova] Releasing lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.214s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.212s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk 1073741824" returned: 0 in 0.073s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Cannot resize image /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Ensure instance console log exists: /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG nova.network.neutron [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Successfully created port: 9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:47:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Successfully updated port: 9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "refresh_cache-c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquired lock "refresh_cache-c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-7224dc69-dbf1-414a-b8ed-4811fac7f546 req-43b90130-066c-4c6f-be22-414b6fd70f2a service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Received event network-changed-9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-7224dc69-dbf1-414a-b8ed-4811fac7f546 req-43b90130-066c-4c6f-be22-414b6fd70f2a service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Refreshing instance network info cache due to event network-changed-9c6d4515-118a-4781-b086-7949a264cd4a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7224dc69-dbf1-414a-b8ed-4811fac7f546 req-43b90130-066c-4c6f-be22-414b6fd70f2a service nova] Acquiring lock "refresh_cache-c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Updating instance_info_cache with network_info: [{"id": "9c6d4515-118a-4781-b086-7949a264cd4a", "address": "fa:16:3e:d8:fe:d4", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d4515-11", "ovs_interfaceid": "9c6d4515-118a-4781-b086-7949a264cd4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Releasing lock "refresh_cache-c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Instance network_info: |[{"id": "9c6d4515-118a-4781-b086-7949a264cd4a", "address": "fa:16:3e:d8:fe:d4", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d4515-11", "ovs_interfaceid": "9c6d4515-118a-4781-b086-7949a264cd4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7224dc69-dbf1-414a-b8ed-4811fac7f546 req-43b90130-066c-4c6f-be22-414b6fd70f2a service nova] Acquired lock "refresh_cache-c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.network.neutron [req-7224dc69-dbf1-414a-b8ed-4811fac7f546 req-43b90130-066c-4c6f-be22-414b6fd70f2a service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Refreshing network info cache for port 9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Start _get_guest_xml network_info=[{"id": "9c6d4515-118a-4781-b086-7949a264cd4a", "address": "fa:16:3e:d8:fe:d4", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d4515-11", "ovs_interfaceid": "9c6d4515-118a-4781-b086-7949a264cd4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:47:43 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:47:43 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109383698',display_name='tempest-AttachVolumeNegativeTest-server-109383698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109383698',id=30,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGIznN47Tlg4AQYgLVNXaLyq1oxRS8eUodpS+XnCivMddtx2a3LO2Rxcdi0X5ho40W/k40V6Qtif/QlFhWdkG9AZNg61fGunQ+GqpZrmZachcHp4KHcYkjQKOlat6Blsg==',key_name='tempest-keypair-808515825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-eyne02q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:47:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c6d4515-118a-4781-b086-7949a264cd4a", "address": "fa:16:3e:d8:fe:d4", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d4515-11", "ovs_interfaceid": "9c6d4515-118a-4781-b086-7949a264cd4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "9c6d4515-118a-4781-b086-7949a264cd4a", "address": "fa:16:3e:d8:fe:d4", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d4515-11", "ovs_interfaceid": "9c6d4515-118a-4781-b086-7949a264cd4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fe:d4,bridge_name='br-int',has_traffic_filtering=True,id=9c6d4515-118a-4781-b086-7949a264cd4a,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d4515-11') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.objects.instance [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'pci_devices' on Instance uuid c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:47:43 user nova-compute[73068]:   <uuid>c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54</uuid>
Aug 26 11:47:43 user nova-compute[73068]:   <name>instance-0000001e</name>
Aug 26 11:47:43 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:47:43 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:47:43 user nova-compute[73068]:   <metadata>
Aug 26 11:47:43 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:47:43 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:47:43 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeNegativeTest-server-109383698</nova:name>
Aug 26 11:47:43 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:47:43</nova:creationTime>
Aug 26 11:47:43 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:47:43 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:47:43 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:47:43 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:47:43 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:47:43 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:47:43 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:47:43 user nova-compute[73068]:       <nova:owner>
Aug 26 11:47:43 user nova-compute[73068]:         <nova:user uuid="613022b47a2e40ca949864fa83fa2e73">tempest-AttachVolumeNegativeTest-1321002765-project-member</nova:user>
Aug 26 11:47:43 user nova-compute[73068]:         <nova:project uuid="770f7f84d7714f8d94971cae316c2215">tempest-AttachVolumeNegativeTest-1321002765</nova:project>
Aug 26 11:47:43 user nova-compute[73068]:       </nova:owner>
Aug 26 11:47:43 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:47:43 user nova-compute[73068]:       <nova:ports>
Aug 26 11:47:43 user nova-compute[73068]:         <nova:port uuid="9c6d4515-118a-4781-b086-7949a264cd4a">
Aug 26 11:47:43 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 11:47:43 user nova-compute[73068]:         </nova:port>
Aug 26 11:47:43 user nova-compute[73068]:       </nova:ports>
Aug 26 11:47:43 user nova-compute[73068]:     </nova:instance>
Aug 26 11:47:43 user nova-compute[73068]:   </metadata>
Aug 26 11:47:43 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:47:43 user nova-compute[73068]:     <system>
Aug 26 11:47:43 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:47:43 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:47:43 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:47:43 user nova-compute[73068]:       <entry name="serial">c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54</entry>
Aug 26 11:47:43 user nova-compute[73068]:       <entry name="uuid">c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54</entry>
Aug 26 11:47:43 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:47:43 user nova-compute[73068]:     </system>
Aug 26 11:47:43 user nova-compute[73068]:   </sysinfo>
Aug 26 11:47:43 user nova-compute[73068]:   <os>
Aug 26 11:47:43 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:47:43 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:47:43 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:47:43 user nova-compute[73068]:   </os>
Aug 26 11:47:43 user nova-compute[73068]:   <features>
Aug 26 11:47:43 user nova-compute[73068]:     <acpi/>
Aug 26 11:47:43 user nova-compute[73068]:     <apic/>
Aug 26 11:47:43 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:47:43 user nova-compute[73068]:   </features>
Aug 26 11:47:43 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:47:43 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:47:43 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:47:43 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:47:43 user nova-compute[73068]:   </clock>
Aug 26 11:47:43 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:47:43 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:47:43 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:47:43 user nova-compute[73068]:   </cpu>
Aug 26 11:47:43 user nova-compute[73068]:   <devices>
Aug 26 11:47:43 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:47:43 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:47:43 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk"/>
Aug 26 11:47:43 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:47:43 user nova-compute[73068]:     </disk>
Aug 26 11:47:43 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:47:43 user nova-compute[73068]:       <mac address="fa:16:3e:d8:fe:d4"/>
Aug 26 11:47:43 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:47:43 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:47:43 user nova-compute[73068]:       <target dev="tap9c6d4515-11"/>
Aug 26 11:47:43 user nova-compute[73068]:     </interface>
Aug 26 11:47:43 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:47:43 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/console.log" append="off"/>
Aug 26 11:47:43 user nova-compute[73068]:     </serial>
Aug 26 11:47:43 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:47:43 user nova-compute[73068]:     <video>
Aug 26 11:47:43 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:47:43 user nova-compute[73068]:     </video>
Aug 26 11:47:43 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:47:43 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:47:43 user nova-compute[73068]:     </rng>
Aug 26 11:47:43 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:47:43 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:47:43 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:47:43 user nova-compute[73068]:     </memballoon>
Aug 26 11:47:43 user nova-compute[73068]:   </devices>
Aug 26 11:47:43 user nova-compute[73068]: </domain>
Aug 26 11:47:43 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109383698',display_name='tempest-AttachVolumeNegativeTest-server-109383698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109383698',id=30,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGIznN47Tlg4AQYgLVNXaLyq1oxRS8eUodpS+XnCivMddtx2a3LO2Rxcdi0X5ho40W/k40V6Qtif/QlFhWdkG9AZNg61fGunQ+GqpZrmZachcHp4KHcYkjQKOlat6Blsg==',key_name='tempest-keypair-808515825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-eyne02q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:47:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c6d4515-118a-4781-b086-7949a264cd4a", "address": "fa:16:3e:d8:fe:d4", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d4515-11", "ovs_interfaceid": "9c6d4515-118a-4781-b086-7949a264cd4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "9c6d4515-118a-4781-b086-7949a264cd4a", "address": "fa:16:3e:d8:fe:d4", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d4515-11", "ovs_interfaceid": "9c6d4515-118a-4781-b086-7949a264cd4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fe:d4,bridge_name='br-int',has_traffic_filtering=True,id=9c6d4515-118a-4781-b086-7949a264cd4a,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d4515-11') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG os_vif [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fe:d4,bridge_name='br-int',has_traffic_filtering=True,id=9c6d4515-118a-4781-b086-7949a264cd4a,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d4515-11') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c6d4515-11, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c6d4515-11, col_values=(('external_ids', {'iface-id': '9c6d4515-118a-4781-b086-7949a264cd4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:fe:d4', 'vm-uuid': 'c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:43 user nova-compute[73068]: INFO os_vif [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fe:d4,bridge_name='br-int',has_traffic_filtering=True,id=9c6d4515-118a-4781-b086-7949a264cd4a,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d4515-11')
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:47:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No VIF found with MAC fa:16:3e:d8:fe:d4, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:47:44 user nova-compute[73068]: DEBUG nova.network.neutron [req-7224dc69-dbf1-414a-b8ed-4811fac7f546 req-43b90130-066c-4c6f-be22-414b6fd70f2a service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Updated VIF entry in instance network info cache for port 9c6d4515-118a-4781-b086-7949a264cd4a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:47:44 user nova-compute[73068]: DEBUG nova.network.neutron [req-7224dc69-dbf1-414a-b8ed-4811fac7f546 req-43b90130-066c-4c6f-be22-414b6fd70f2a service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Updating instance_info_cache with network_info: [{"id": "9c6d4515-118a-4781-b086-7949a264cd4a", "address": "fa:16:3e:d8:fe:d4", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d4515-11", "ovs_interfaceid": "9c6d4515-118a-4781-b086-7949a264cd4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:47:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7224dc69-dbf1-414a-b8ed-4811fac7f546 req-43b90130-066c-4c6f-be22-414b6fd70f2a service nova] Releasing lock "refresh_cache-c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-7c88af68-d0dd-4260-9346-c1c8730a3988 req-ec140823-b77a-4031-bd0f-966db6884e29 service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Received event network-vif-plugged-9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c88af68-d0dd-4260-9346-c1c8730a3988 req-ec140823-b77a-4031-bd0f-966db6884e29 service nova] Acquiring lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c88af68-d0dd-4260-9346-c1c8730a3988 req-ec140823-b77a-4031-bd0f-966db6884e29 service nova] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c88af68-d0dd-4260-9346-c1c8730a3988 req-ec140823-b77a-4031-bd0f-966db6884e29 service nova] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-7c88af68-d0dd-4260-9346-c1c8730a3988 req-ec140823-b77a-4031-bd0f-966db6884e29 service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] No waiting events found dispatching network-vif-plugged-9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:47:45 user nova-compute[73068]: WARNING nova.compute.manager [req-7c88af68-d0dd-4260-9346-c1c8730a3988 req-ec140823-b77a-4031-bd0f-966db6884e29 service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Received unexpected event network-vif-plugged-9c6d4515-118a-4781-b086-7949a264cd4a for instance with vm_state building and task_state spawning.
Aug 26 11:47:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG nova.objects.instance [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:46 user nova-compute[73068]: INFO nova.compute.manager [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Attaching volume 3e68939a-baa1-46a3-8377-41766a576bac to /dev/vdb
Aug 26 11:47:46 user nova-compute[73068]: DEBUG os_brick.utils [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[414a2c3e-642f-4e60-90ce-c2042ffe4d28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8840b5-d390-48d5-9782-88c33f94528d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b3527a-1784-41a1-a604-201634f6c460]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2029f366-7951-4c06-885a-28efd8df625a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:47:46 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:47:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a5e288-f2b9-47ac-b335-46b8b7b3be23]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG os_brick.utils [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:47:46 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Updating existing volume attachment record: 3812b832-3be5-44ee-8fba-c76b1317e7c4 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050467.3883345, c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:47:47 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] VM Resumed (Lifecycle Event)
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:47:47 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Instance spawned successfully.
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:47:47 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050467.3902926, c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:47:47 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] VM Started (Lifecycle Event)
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-74e77728-3c95-4492-9a5a-6665fafee9eb req-d11e06e9-1983-486e-ba35-235017e26a52 service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Received event network-vif-plugged-9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-74e77728-3c95-4492-9a5a-6665fafee9eb req-d11e06e9-1983-486e-ba35-235017e26a52 service nova] Acquiring lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-74e77728-3c95-4492-9a5a-6665fafee9eb req-d11e06e9-1983-486e-ba35-235017e26a52 service nova] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-74e77728-3c95-4492-9a5a-6665fafee9eb req-d11e06e9-1983-486e-ba35-235017e26a52 service nova] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-74e77728-3c95-4492-9a5a-6665fafee9eb req-d11e06e9-1983-486e-ba35-235017e26a52 service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] No waiting events found dispatching network-vif-plugged-9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:47:47 user nova-compute[73068]: WARNING nova.compute.manager [req-74e77728-3c95-4492-9a5a-6665fafee9eb req-d11e06e9-1983-486e-ba35-235017e26a52 service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Received unexpected event network-vif-plugged-9c6d4515-118a-4781-b086-7949a264cd4a for instance with vm_state building and task_state spawning.
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:47:47 user nova-compute[73068]: INFO nova.compute.manager [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Took 6.24 seconds to spawn the instance on the hypervisor.
Aug 26 11:47:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:47:47 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:47:47 user nova-compute[73068]: INFO nova.compute.manager [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Took 7.15 seconds to build instance.
Aug 26 11:47:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-14efe7be-dca8-4763-a991-2d5e84c8a897 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.429s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:48 user nova-compute[73068]: INFO nova.compute.manager [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Detaching volume 56debc60-4388-4f1a-8e65-bd6a2a67c737
Aug 26 11:47:48 user nova-compute[73068]: INFO nova.virt.block_device [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Attempting to driver detach volume 56debc60-4388-4f1a-8e65-bd6a2a67c737 from mountpoint /dev/vdc
Aug 26 11:47:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Attempting to detach device vdc from instance a39507fb-9897-4e5d-8217-390785208d52 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:47:48 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:47:48 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:47:48 user nova-compute[73068]:   <target dev="vdc" bus="virtio"/>
Aug 26 11:47:48 user nova-compute[73068]:   <serial>56debc60-4388-4f1a-8e65-bd6a2a67c737</serial>
Aug 26 11:47:48 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 11:47:48 user nova-compute[73068]: </disk>
Aug 26 11:47:48 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:47:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Successfully detached device vdc from instance a39507fb-9897-4e5d-8217-390785208d52 from the persistent domain config.
Aug 26 11:47:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a39507fb-9897-4e5d-8217-390785208d52 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:47:48 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:47:48 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:47:48 user nova-compute[73068]:   <target dev="vdc" bus="virtio"/>
Aug 26 11:47:48 user nova-compute[73068]:   <serial>56debc60-4388-4f1a-8e65-bd6a2a67c737</serial>
Aug 26 11:47:48 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 11:47:48 user nova-compute[73068]: </disk>
Aug 26 11:47:48 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050468.6761212, a39507fb-9897-4e5d-8217-390785208d52 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:47:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Successfully detached device vdc from instance a39507fb-9897-4e5d-8217-390785208d52 from the live domain config.
Aug 26 11:47:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OHqkzMlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:47:48 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8716447b-cea7-4080-8589-33d23e07f270]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce83e470-1a1e-474a-8520-ae04f12867b4]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:47:48 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 (non-flash)
Aug 26 11:47:48 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd902880d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a64701-182d-4e70-b84f-83574edc9cc1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99d9f3e-835e-44f9-9184-c082f02b9992]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dc8690-ae6c-4212-a482-970d3ee12f31]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a391865-f0d9-4dee-b1dc-3b2da834dc65]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9149c8a3-6b69-42e5-b91c-a461b34b3098]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cb2e6d-400c-4e76-89ed-6f35de1ba3b1]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737, portal: 172.16.0.220,3260]
Aug 26 11:47:48 user nova-compute[73068]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737, portal: 172.16.0.220,3260] successful.
Aug 26 11:47:48 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56debc60-4388-4f1a-8e65-bd6a2a67c737 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f621594-e60f-4fbd-8646-17de0b7748c5]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] <== disconnect_volume: return (296ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:47:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:47:49 user nova-compute[73068]: DEBUG nova.objects.instance [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'flavor' on Instance uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:47:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-66a5d1e4-36ef-4be1-8981-68027726e022 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.858s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:50 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:47:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:52 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:47:53 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:47:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:47:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:57 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:47:57 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:47:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7306MB free_disk=25.387081146240234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:47:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:47:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance e1132a5d-535a-4e72-8d03-25ea977f0034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ffe8d8fe-cc8f-44ab-8b95-5db1772b724d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 41ef2264-c365-44ee-b4aa-8266e3537c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a39507fb-9897-4e5d-8217-390785208d52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 17331d3e-f9d6-40bd-b68b-4444cf885e48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4695a204-a297-4971-bb38-2229dbba7a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8f7236c5-6af7-4f5e-9598-f712ecff61bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JofdKQiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:47:58 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:47:58 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:47:58 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[86263ccb-3ac1-40cf-a2eb-ed7ac0ef2d05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:47:58 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa5a4d0-5e5f-4009-b9dc-ebe110491b6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac] added
Aug 26 11:47:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf622de-1e00-490e-8c9c-6d7ce074f98f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.847s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[20189ed8-17b7-4d28-a1b8-39212e6e684e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JofdKQiL {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JofdKQiL" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[649ad336-dab0-47a6-982b-dec4fb5dcc38]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JofdKQiL'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aba5e67-1e0d-45a6-87bb-677c3f9b4470]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7664b22f-c9c2-4f2b-8272-1c1aba196e10]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 11:47:58 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 11:47:58 user nova-compute[73068]:  {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:47:58 user nova-compute[73068]: WARNING os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 11:47:58 user nova-compute[73068]: 
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[20618ab5-f18b-49c2-b697-b29f86bad14d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260]
Aug 26 11:47:58 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260] successful.
Aug 26 11:47:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[313ce797-0ea9-4a7a-ad5e-ca7ab0e02403]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e62d01-a25c-4924-baee-983ad4c84473]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:47:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:47:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:47:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:47:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:47:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75a9e71-7d0b-49e1-bc7c-ea4de75d7868]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:47:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:47:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JofdKQiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:47:59 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:47:59 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23333306364373961', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333306364373961', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG nova.objects.instance [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:48:00 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:48:00 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:48:00 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:48:00 user nova-compute[73068]:   <serial>3e68939a-baa1-46a3-8377-41766a576bac</serial>
Aug 26 11:48:00 user nova-compute[73068]: </disk>
Aug 26 11:48:00 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No VIF found with MAC fa:16:3e:eb:08:a7, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:48:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-603c3c31-fe8b-44aa-a709-a0469ebcd2db tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.637s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updating instance_info_cache with network_info: [{"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e92ddf59-1f2a-476c-bf9e-aae1a668d74c tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e92ddf59-1f2a-476c-bf9e-aae1a668d74c tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e92ddf59-1f2a-476c-bf9e-aae1a668d74c tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e92ddf59-1f2a-476c-bf9e-aae1a668d74c tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73068) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e92ddf59-1f2a-476c-bf9e-aae1a668d74c tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-d38a0421-adc3-44ee-90ea-a69f8e5a5a7c req-2862fee9-4253-4aef-a798-a2f59fecf14c service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-unplugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d38a0421-adc3-44ee-90ea-a69f8e5a5a7c req-2862fee9-4253-4aef-a798-a2f59fecf14c service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d38a0421-adc3-44ee-90ea-a69f8e5a5a7c req-2862fee9-4253-4aef-a798-a2f59fecf14c service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d38a0421-adc3-44ee-90ea-a69f8e5a5a7c req-2862fee9-4253-4aef-a798-a2f59fecf14c service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-d38a0421-adc3-44ee-90ea-a69f8e5a5a7c req-2862fee9-4253-4aef-a798-a2f59fecf14c service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-unplugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:48:02 user nova-compute[73068]: WARNING nova.compute.manager [req-d38a0421-adc3-44ee-90ea-a69f8e5a5a7c req-2862fee9-4253-4aef-a798-a2f59fecf14c service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received unexpected event network-vif-unplugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with vm_state active and task_state powering-off.
Aug 26 11:48:02 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance destroyed successfully.
Aug 26 11:48:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e92ddf59-1f2a-476c-bf9e-aae1a668d74c tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:48:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e92ddf59-1f2a-476c-bf9e-aae1a668d74c tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.028s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:04 user nova-compute[73068]: DEBUG nova.compute.manager [req-d8b75b7b-fc85-4ebc-8ed2-f2c52751786f req-53112a35-5fed-479f-b2d5-2f6888646949 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d8b75b7b-fc85-4ebc-8ed2-f2c52751786f req-53112a35-5fed-479f-b2d5-2f6888646949 service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d8b75b7b-fc85-4ebc-8ed2-f2c52751786f req-53112a35-5fed-479f-b2d5-2f6888646949 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d8b75b7b-fc85-4ebc-8ed2-f2c52751786f req-53112a35-5fed-479f-b2d5-2f6888646949 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:04 user nova-compute[73068]: DEBUG nova.compute.manager [req-d8b75b7b-fc85-4ebc-8ed2-f2c52751786f req-53112a35-5fed-479f-b2d5-2f6888646949 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:48:04 user nova-compute[73068]: WARNING nova.compute.manager [req-d8b75b7b-fc85-4ebc-8ed2-f2c52751786f req-53112a35-5fed-479f-b2d5-2f6888646949 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received unexpected event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with vm_state stopped and task_state None.
Aug 26 11:48:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:17 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050482.2896967, 41ef2264-c365-44ee-b4aa-8266e3537c73 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:48:17 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] VM Stopped (Lifecycle Event)
Aug 26 11:48:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a08550db-47d1-4bd3-bda9-a623d242137b None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:48:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a08550db-47d1-4bd3-bda9-a623d242137b None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Acquiring lock "17331d3e-f9d6-40bd-b68b-4444cf885e48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Acquiring lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:18 user nova-compute[73068]: INFO nova.compute.manager [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Terminating instance
Aug 26 11:48:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-21908137-a2c2-4aac-9f63-7edb59cc7be2 req-9d855940-a607-47d7-975b-ca169bb39819 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Received event network-vif-unplugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-21908137-a2c2-4aac-9f63-7edb59cc7be2 req-9d855940-a607-47d7-975b-ca169bb39819 service nova] Acquiring lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-21908137-a2c2-4aac-9f63-7edb59cc7be2 req-9d855940-a607-47d7-975b-ca169bb39819 service nova] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-21908137-a2c2-4aac-9f63-7edb59cc7be2 req-9d855940-a607-47d7-975b-ca169bb39819 service nova] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-21908137-a2c2-4aac-9f63-7edb59cc7be2 req-9d855940-a607-47d7-975b-ca169bb39819 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] No waiting events found dispatching network-vif-unplugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:48:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-21908137-a2c2-4aac-9f63-7edb59cc7be2 req-9d855940-a607-47d7-975b-ca169bb39819 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Received event network-vif-unplugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:48:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Instance destroyed successfully.
Aug 26 11:48:19 user nova-compute[73068]: DEBUG nova.objects.instance [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lazy-loading 'resources' on Instance uuid 17331d3e-f9d6-40bd-b68b-4444cf885e48 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:48:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:46:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-649050669',display_name='tempest-VolumesNegativeTest-instance-649050669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-649050669',id=27,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:46:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b654a353710c4870b5744a2b2a4479ab',ramdisk_id='',reservation_id='r-9b7sj3fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-750477456',owner_user_name='tempest-VolumesNegativeTest-750477456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:46:36Z,user_data=None,user_id='7cef57755ec14392995b505d7d4808ed',uuid=17331d3e-f9d6-40bd-b68b-4444cf885e48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "address": "fa:16:3e:57:f6:f3", "network": {"id": "ca043a60-ba74-4b5d-8c57-af7ab10e981b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88c40a3031b540a29dc52c683b2d1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5135b652-5d", "ovs_interfaceid": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:48:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Converting VIF {"id": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "address": "fa:16:3e:57:f6:f3", "network": {"id": "ca043a60-ba74-4b5d-8c57-af7ab10e981b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "88c40a3031b540a29dc52c683b2d1682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5135b652-5d", "ovs_interfaceid": "5135b652-5d3c-427b-aeaf-2b2a38326fa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:48:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:f6:f3,bridge_name='br-int',has_traffic_filtering=True,id=5135b652-5d3c-427b-aeaf-2b2a38326fa3,network=Network(ca043a60-ba74-4b5d-8c57-af7ab10e981b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5135b652-5d') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:48:19 user nova-compute[73068]: DEBUG os_vif [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:f6:f3,bridge_name='br-int',has_traffic_filtering=True,id=5135b652-5d3c-427b-aeaf-2b2a38326fa3,network=Network(ca043a60-ba74-4b5d-8c57-af7ab10e981b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5135b652-5d') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:48:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5135b652-5d, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:48:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:48:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:19 user nova-compute[73068]: INFO os_vif [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:f6:f3,bridge_name='br-int',has_traffic_filtering=True,id=5135b652-5d3c-427b-aeaf-2b2a38326fa3,network=Network(ca043a60-ba74-4b5d-8c57-af7ab10e981b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5135b652-5d')
Aug 26 11:48:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Deleting instance files /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48_del
Aug 26 11:48:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Deletion of /opt/stack/data/nova/instances/17331d3e-f9d6-40bd-b68b-4444cf885e48_del complete
Aug 26 11:48:19 user nova-compute[73068]: INFO nova.compute.manager [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 26 11:48:19 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:48:19 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:48:19 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:48:20 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:48:20 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Took 0.76 seconds to deallocate network for instance.
Aug 26 11:48:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:20 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:48:20 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:48:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:20 user nova-compute[73068]: DEBUG nova.compute.manager [req-1d7a0a41-bed7-466c-8b5a-251a72ea65e2 req-26bb0b74-7ebe-4463-9df3-c3e76acb3eb7 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Received event network-vif-plugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1d7a0a41-bed7-466c-8b5a-251a72ea65e2 req-26bb0b74-7ebe-4463-9df3-c3e76acb3eb7 service nova] Acquiring lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1d7a0a41-bed7-466c-8b5a-251a72ea65e2 req-26bb0b74-7ebe-4463-9df3-c3e76acb3eb7 service nova] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1d7a0a41-bed7-466c-8b5a-251a72ea65e2 req-26bb0b74-7ebe-4463-9df3-c3e76acb3eb7 service nova] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:20 user nova-compute[73068]: DEBUG nova.compute.manager [req-1d7a0a41-bed7-466c-8b5a-251a72ea65e2 req-26bb0b74-7ebe-4463-9df3-c3e76acb3eb7 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] No waiting events found dispatching network-vif-plugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:48:20 user nova-compute[73068]: WARNING nova.compute.manager [req-1d7a0a41-bed7-466c-8b5a-251a72ea65e2 req-26bb0b74-7ebe-4463-9df3-c3e76acb3eb7 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Received unexpected event network-vif-plugged-5135b652-5d3c-427b-aeaf-2b2a38326fa3 for instance with vm_state deleted and task_state None.
Aug 26 11:48:20 user nova-compute[73068]: DEBUG nova.compute.manager [req-1d7a0a41-bed7-466c-8b5a-251a72ea65e2 req-26bb0b74-7ebe-4463-9df3-c3e76acb3eb7 service nova] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Received event network-vif-deleted-5135b652-5d3c-427b-aeaf-2b2a38326fa3 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:20 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Deleted allocations for instance 17331d3e-f9d6-40bd-b68b-4444cf885e48
Aug 26 11:48:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2ab8e922-03f2-4913-b012-3cf8c9332a3b tempest-VolumesNegativeTest-750477456 tempest-VolumesNegativeTest-750477456-project-member] Lock "17331d3e-f9d6-40bd-b68b-4444cf885e48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.621s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-5563ac40-ded9-4823-8b26-939e581def1d req-e8914855-294c-4739-8f1c-f969155c80e0 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-changed-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-5563ac40-ded9-4823-8b26-939e581def1d req-e8914855-294c-4739-8f1c-f969155c80e0 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Refreshing instance network info cache due to event network-changed-f4e85893-b8db-4042-9f14-8b4678f476ed. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:48:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5563ac40-ded9-4823-8b26-939e581def1d req-e8914855-294c-4739-8f1c-f969155c80e0 service nova] Acquiring lock "refresh_cache-4695a204-a297-4971-bb38-2229dbba7a06" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:48:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5563ac40-ded9-4823-8b26-939e581def1d req-e8914855-294c-4739-8f1c-f969155c80e0 service nova] Acquired lock "refresh_cache-4695a204-a297-4971-bb38-2229dbba7a06" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:48:30 user nova-compute[73068]: DEBUG nova.network.neutron [req-5563ac40-ded9-4823-8b26-939e581def1d req-e8914855-294c-4739-8f1c-f969155c80e0 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Refreshing network info cache for port f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:48:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'flavor' on Instance uuid 4695a204-a297-4971-bb38-2229dbba7a06 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-5563ac40-ded9-4823-8b26-939e581def1d req-e8914855-294c-4739-8f1c-f969155c80e0 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Updated VIF entry in instance network info cache for port f4e85893-b8db-4042-9f14-8b4678f476ed. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-5563ac40-ded9-4823-8b26-939e581def1d req-e8914855-294c-4739-8f1c-f969155c80e0 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Updating instance_info_cache with network_info: [{"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5563ac40-ded9-4823-8b26-939e581def1d req-e8914855-294c-4739-8f1c-f969155c80e0 service nova] Releasing lock "refresh_cache-4695a204-a297-4971-bb38-2229dbba7a06" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:31 user nova-compute[73068]: INFO nova.compute.manager [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Attaching volume 5f0d3b95-6a20-4c59-9fe6-5bd535726501 to /dev/vdb
Aug 26 11:48:31 user nova-compute[73068]: DEBUG os_brick.utils [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3b0ab8-b2b9-4580-9446-62d045c8dc5f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[36536a99-2c3c-4536-8f54-2a5a69545d7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4cd0f3-e5fc-41f8-909c-e2af7eda7952]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bd25f4-f435-410f-bed2-4d97d53ffa07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:48:31 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:48:31 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d7d4b9-49c6-4f73-972b-9a740ab083db]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG os_brick.utils [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:48:31 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Updating existing volume attachment record: f48184c0-004e-4257-809a-133d30a9bf86 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:48:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:34 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050499.4375672, 17331d3e-f9d6-40bd-b68b-4444cf885e48 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:48:34 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] VM Stopped (Lifecycle Event)
Aug 26 11:48:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-236e80c4-8e06-48a1-9233-0f840fe8eedd None None] [instance: 17331d3e-f9d6-40bd-b68b-4444cf885e48] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:48:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquiring lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:37 user nova-compute[73068]: DEBUG nova.objects.instance [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lazy-loading 'flavor' on Instance uuid ffe8d8fe-cc8f-44ab-8b95-5db1772b724d {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:48:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquiring lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:38 user nova-compute[73068]: INFO nova.compute.manager [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Attaching volume 441329fb-b98c-40eb-98ba-10b3820d6e13 to /dev/vdb
Aug 26 11:48:38 user nova-compute[73068]: DEBUG os_brick.utils [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[842b1201-a0d0-4995-8a2a-ee2c73664273]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[de21622f-6ae6-4199-be05-452ddcfd8e5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7297f74f-c341-4309-ac1c-60a9e6900853]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f6251-9986-4af0-8de8-fd3f6b096e6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:48:38 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f652c73b-b35b-4aec-9a47-19b4c059f331]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG os_brick.utils [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Updating existing volume attachment record: 3e0f5e1d-5422-41dd-af0c-85a93ab345ce {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:38 user nova-compute[73068]: INFO nova.compute.manager [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Terminating instance
Aug 26 11:48:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "2011f764-7057-43ba-ba00-834376cc968e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "2011f764-7057-43ba-ba00-834376cc968e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-7d3001f8-624d-4bcf-92b5-cc1001417e09 req-6ce122b9-307e-460e-85d9-96a0c009fd94 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-vif-unplugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7d3001f8-624d-4bcf-92b5-cc1001417e09 req-6ce122b9-307e-460e-85d9-96a0c009fd94 service nova] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7d3001f8-624d-4bcf-92b5-cc1001417e09 req-6ce122b9-307e-460e-85d9-96a0c009fd94 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7d3001f8-624d-4bcf-92b5-cc1001417e09 req-6ce122b9-307e-460e-85d9-96a0c009fd94 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-7d3001f8-624d-4bcf-92b5-cc1001417e09 req-6ce122b9-307e-460e-85d9-96a0c009fd94 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] No waiting events found dispatching network-vif-unplugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-7d3001f8-624d-4bcf-92b5-cc1001417e09 req-6ce122b9-307e-460e-85d9-96a0c009fd94 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-vif-unplugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:48:39 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] Instance destroyed successfully.
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.objects.instance [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'resources' on Instance uuid a39507fb-9897-4e5d-8217-390785208d52 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1102777405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1102777405',id=17,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9Gj2bnIjg7444NWeZckpmwe+Wf6W6d1gltaDp/C9XW68jMmoSS2jQz+RS/tFm7h8fYZMoB2wf4HRsIVu8CUTRpQgs2yU6z7rZaUWorfQO4WfxJNnTHhaZ2pwqgBZtyUw==',key_name='tempest-keypair-1963762537',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-uuvfbky6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:46:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=a39507fb-9897-4e5d-8217-390785208d52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "address": "fa:16:3e:14:98:e8", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0a2f992-36", "ovs_interfaceid": "c0a2f992-3673-45ea-89b4-5f3fa6b65ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG os_vif [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0a2f992-36, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:48:39 user nova-compute[73068]: INFO nova.compute.claims [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Claim successful on node user
Aug 26 11:48:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:39 user nova-compute[73068]: INFO os_vif [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:e8,bridge_name='br-int',has_traffic_filtering=True,id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0a2f992-36')
Aug 26 11:48:39 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Deleting instance files /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52_del
Aug 26 11:48:39 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Deletion of /opt/stack/data/nova/instances/a39507fb-9897-4e5d-8217-390785208d52_del complete
Aug 26 11:48:39 user nova-compute[73068]: INFO nova.compute.manager [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: a39507fb-9897-4e5d-8217-390785208d52] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 26 11:48:39 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:48:39 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:48:40 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:48:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:48:40 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Creating image(s)
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "/opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "/opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "/opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG nova.policy [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cd2bf96810a4540969277c8f94d5a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20a527043d44250bfe0a4b9dbf3e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.255s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk 1073741824" returned: 0 in 0.074s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-beea4b7b-6e99-44e4-85bf-0d0d352732d4 req-dd19d469-8644-432d-89ba-01ada032a319 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-vif-deleted-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:40 user nova-compute[73068]: INFO nova.compute.manager [req-beea4b7b-6e99-44e4-85bf-0d0d352732d4 req-dd19d469-8644-432d-89ba-01ada032a319 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Neutron deleted interface c0a2f992-3673-45ea-89b4-5f3fa6b65ef6; detaching it from the instance and deleting it from the info cache
Aug 26 11:48:40 user nova-compute[73068]: DEBUG nova.network.neutron [req-beea4b7b-6e99-44e4-85bf-0d0d352732d4 req-dd19d469-8644-432d-89ba-01ada032a319 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:48:40 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:48:40 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] Took 1.34 seconds to deallocate network for instance.
Aug 26 11:48:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-beea4b7b-6e99-44e4-85bf-0d0d352732d4 req-dd19d469-8644-432d-89ba-01ada032a319 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Detach interface failed, port_id=c0a2f992-3673-45ea-89b4-5f3fa6b65ef6, reason: Instance a39507fb-9897-4e5d-8217-390785208d52 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.199s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-c14afc72-f5a3-4472-8e53-127e3635686e req-44f2688b-b402-4725-835b-0c193f61f592 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c14afc72-f5a3-4472-8e53-127e3635686e req-44f2688b-b402-4725-835b-0c193f61f592 service nova] Acquiring lock "a39507fb-9897-4e5d-8217-390785208d52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c14afc72-f5a3-4472-8e53-127e3635686e req-44f2688b-b402-4725-835b-0c193f61f592 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c14afc72-f5a3-4472-8e53-127e3635686e req-44f2688b-b402-4725-835b-0c193f61f592 service nova] Lock "a39507fb-9897-4e5d-8217-390785208d52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-c14afc72-f5a3-4472-8e53-127e3635686e req-44f2688b-b402-4725-835b-0c193f61f592 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] No waiting events found dispatching network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:48:41 user nova-compute[73068]: WARNING nova.compute.manager [req-c14afc72-f5a3-4472-8e53-127e3635686e req-44f2688b-b402-4725-835b-0c193f61f592 service nova] [instance: a39507fb-9897-4e5d-8217-390785208d52] Received unexpected event network-vif-plugged-c0a2f992-3673-45ea-89b4-5f3fa6b65ef6 for instance with vm_state deleted and task_state None.
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Cannot resize image /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Ensure instance console log exists: /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG nova.network.neutron [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Successfully created port: 78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:41 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Deleted allocations for instance a39507fb-9897-4e5d-8217-390785208d52
Aug 26 11:48:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd9aec37-1d5d-4440-b0bc-c161ed921d2f tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "a39507fb-9897-4e5d-8217-390785208d52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.183s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:42 user nova-compute[73068]: DEBUG nova.network.neutron [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Successfully updated port: 78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:48:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:48:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquired lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:48:42 user nova-compute[73068]: DEBUG nova.network.neutron [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:48:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-1fd652ea-998a-46ce-885a-a2bf1fbbded5 req-01b449d3-de7b-4596-a533-965fe6eb2815 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Received event network-changed-78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-1fd652ea-998a-46ce-885a-a2bf1fbbded5 req-01b449d3-de7b-4596-a533-965fe6eb2815 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Refreshing instance network info cache due to event network-changed-78c12ef4-3a49-41b6-8efd-1db50299574a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:48:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1fd652ea-998a-46ce-885a-a2bf1fbbded5 req-01b449d3-de7b-4596-a533-965fe6eb2815 service nova] Acquiring lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:48:42 user nova-compute[73068]: DEBUG nova.network.neutron [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updating instance_info_cache with network_info: [{"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Releasing lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Instance network_info: |[{"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1fd652ea-998a-46ce-885a-a2bf1fbbded5 req-01b449d3-de7b-4596-a533-965fe6eb2815 service nova] Acquired lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.network.neutron [req-1fd652ea-998a-46ce-885a-a2bf1fbbded5 req-01b449d3-de7b-4596-a533-965fe6eb2815 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Refreshing network info cache for port 78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Start _get_guest_xml network_info=[{"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:48:43 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:48:43 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1645402505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1645402505',id=31,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-kh0094v9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:48:40Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=2011f764-7057-43ba-ba00-834376cc968e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:7a:80,bridge_name='br-int',has_traffic_filtering=True,id=78c12ef4-3a49-41b6-8efd-1db50299574a,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c12ef4-3a') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.objects.instance [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'pci_devices' on Instance uuid 2011f764-7057-43ba-ba00-834376cc968e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:48:43 user nova-compute[73068]:   <uuid>2011f764-7057-43ba-ba00-834376cc968e</uuid>
Aug 26 11:48:43 user nova-compute[73068]:   <name>instance-0000001f</name>
Aug 26 11:48:43 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:48:43 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:48:43 user nova-compute[73068]:   <metadata>
Aug 26 11:48:43 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:48:43 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:48:43 user nova-compute[73068]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1645402505</nova:name>
Aug 26 11:48:43 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:48:43</nova:creationTime>
Aug 26 11:48:43 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:48:43 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:48:43 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:48:43 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:48:43 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:48:43 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:48:43 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:48:43 user nova-compute[73068]:       <nova:owner>
Aug 26 11:48:43 user nova-compute[73068]:         <nova:user uuid="9cd2bf96810a4540969277c8f94d5a6d">tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member</nova:user>
Aug 26 11:48:43 user nova-compute[73068]:         <nova:project uuid="d20a527043d44250bfe0a4b9dbf3e00d">tempest-ServerBootFromVolumeStableRescueTest-343541457</nova:project>
Aug 26 11:48:43 user nova-compute[73068]:       </nova:owner>
Aug 26 11:48:43 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:48:43 user nova-compute[73068]:       <nova:ports>
Aug 26 11:48:43 user nova-compute[73068]:         <nova:port uuid="78c12ef4-3a49-41b6-8efd-1db50299574a">
Aug 26 11:48:43 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 11:48:43 user nova-compute[73068]:         </nova:port>
Aug 26 11:48:43 user nova-compute[73068]:       </nova:ports>
Aug 26 11:48:43 user nova-compute[73068]:     </nova:instance>
Aug 26 11:48:43 user nova-compute[73068]:   </metadata>
Aug 26 11:48:43 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:48:43 user nova-compute[73068]:     <system>
Aug 26 11:48:43 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:48:43 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:48:43 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:48:43 user nova-compute[73068]:       <entry name="serial">2011f764-7057-43ba-ba00-834376cc968e</entry>
Aug 26 11:48:43 user nova-compute[73068]:       <entry name="uuid">2011f764-7057-43ba-ba00-834376cc968e</entry>
Aug 26 11:48:43 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:48:43 user nova-compute[73068]:     </system>
Aug 26 11:48:43 user nova-compute[73068]:   </sysinfo>
Aug 26 11:48:43 user nova-compute[73068]:   <os>
Aug 26 11:48:43 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:48:43 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:48:43 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:48:43 user nova-compute[73068]:   </os>
Aug 26 11:48:43 user nova-compute[73068]:   <features>
Aug 26 11:48:43 user nova-compute[73068]:     <acpi/>
Aug 26 11:48:43 user nova-compute[73068]:     <apic/>
Aug 26 11:48:43 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:48:43 user nova-compute[73068]:   </features>
Aug 26 11:48:43 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:48:43 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:48:43 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:48:43 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:48:43 user nova-compute[73068]:   </clock>
Aug 26 11:48:43 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:48:43 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:48:43 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:48:43 user nova-compute[73068]:   </cpu>
Aug 26 11:48:43 user nova-compute[73068]:   <devices>
Aug 26 11:48:43 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:48:43 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:48:43 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk"/>
Aug 26 11:48:43 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:48:43 user nova-compute[73068]:     </disk>
Aug 26 11:48:43 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:48:43 user nova-compute[73068]:       <mac address="fa:16:3e:94:7a:80"/>
Aug 26 11:48:43 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:48:43 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:48:43 user nova-compute[73068]:       <target dev="tap78c12ef4-3a"/>
Aug 26 11:48:43 user nova-compute[73068]:     </interface>
Aug 26 11:48:43 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:48:43 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/console.log" append="off"/>
Aug 26 11:48:43 user nova-compute[73068]:     </serial>
Aug 26 11:48:43 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:48:43 user nova-compute[73068]:     <video>
Aug 26 11:48:43 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:48:43 user nova-compute[73068]:     </video>
Aug 26 11:48:43 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:48:43 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:48:43 user nova-compute[73068]:     </rng>
Aug 26 11:48:43 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:48:43 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:48:43 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:48:43 user nova-compute[73068]:     </memballoon>
Aug 26 11:48:43 user nova-compute[73068]:   </devices>
Aug 26 11:48:43 user nova-compute[73068]: </domain>
Aug 26 11:48:43 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1645402505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1645402505',id=31,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-kh0094v9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:48:40Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=2011f764-7057-43ba-ba00-834376cc968e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:7a:80,bridge_name='br-int',has_traffic_filtering=True,id=78c12ef4-3a49-41b6-8efd-1db50299574a,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c12ef4-3a') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG os_vif [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:7a:80,bridge_name='br-int',has_traffic_filtering=True,id=78c12ef4-3a49-41b6-8efd-1db50299574a,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c12ef4-3a') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78c12ef4-3a, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78c12ef4-3a, col_values=(('external_ids', {'iface-id': '78c12ef4-3a49-41b6-8efd-1db50299574a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:7a:80', 'vm-uuid': '2011f764-7057-43ba-ba00-834376cc968e'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:43 user nova-compute[73068]: INFO os_vif [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:7a:80,bridge_name='br-int',has_traffic_filtering=True,id=78c12ef4-3a49-41b6-8efd-1db50299574a,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c12ef4-3a')
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No VIF found with MAC fa:16:3e:94:7a:80, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.network.neutron [req-1fd652ea-998a-46ce-885a-a2bf1fbbded5 req-01b449d3-de7b-4596-a533-965fe6eb2815 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updated VIF entry in instance network info cache for port 78c12ef4-3a49-41b6-8efd-1db50299574a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG nova.network.neutron [req-1fd652ea-998a-46ce-885a-a2bf1fbbded5 req-01b449d3-de7b-4596-a533-965fe6eb2815 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updating instance_info_cache with network_info: [{"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:48:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1fd652ea-998a-46ce-885a-a2bf1fbbded5 req-01b449d3-de7b-4596-a533-965fe6eb2815 service nova] Releasing lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTQPZfIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:48:44 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:48:44 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:48:44 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b969252-8104-4e0c-8277-841e61bb591f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:48:44 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66674b2-b170-4c1e-ad8f-fb0fd605d7ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501] added
Aug 26 11:48:44 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab06f31-8c80-4a2a-8f01-190704bc147b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca1e723-6bec-4ce1-b79f-3200f0c03aea]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTQPZfIr {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTQPZfIr" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb1ecac-98b3-4885-b1bc-26d8261e64e8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bTQPZfIr'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbdbb00-f843-4634-ae71-0edec0f826f6]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[182aed98-1f32-4bab-ab69-d12ecfedfad6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:48:44 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:48:44 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9611021e-29da-4450-91ee-ffd20203162a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260]
Aug 26 11:48:44 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260] successful.
Aug 26 11:48:44 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:48:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6366344a-b5e3-4c22-b701-db862584b9aa]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[32961180-d3ea-494c-964a-2e8fce792149]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:48:45 user nova-compute[73068]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:48:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:48:45 user nova-compute[73068]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:48:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b9f383-a8fa-4b1a-a191-dfe019909b9d]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTQPZfIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-d8cf8946-7111-478c-bc9a-cbcf785203e9 req-fb8a0242-53e3-4058-a681-0e9d7e9672ab service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Received event network-vif-plugged-78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d8cf8946-7111-478c-bc9a-cbcf785203e9 req-fb8a0242-53e3-4058-a681-0e9d7e9672ab service nova] Acquiring lock "2011f764-7057-43ba-ba00-834376cc968e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d8cf8946-7111-478c-bc9a-cbcf785203e9 req-fb8a0242-53e3-4058-a681-0e9d7e9672ab service nova] Lock "2011f764-7057-43ba-ba00-834376cc968e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d8cf8946-7111-478c-bc9a-cbcf785203e9 req-fb8a0242-53e3-4058-a681-0e9d7e9672ab service nova] Lock "2011f764-7057-43ba-ba00-834376cc968e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-d8cf8946-7111-478c-bc9a-cbcf785203e9 req-fb8a0242-53e3-4058-a681-0e9d7e9672ab service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] No waiting events found dispatching network-vif-plugged-78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:48:45 user nova-compute[73068]: WARNING nova.compute.manager [req-d8cf8946-7111-478c-bc9a-cbcf785203e9 req-fb8a0242-53e3-4058-a681-0e9d7e9672ab service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Received unexpected event network-vif-plugged-78c12ef4-3a49-41b6-8efd-1db50299574a for instance with vm_state building and task_state spawning.
Aug 26 11:48:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:48:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26338643533376333', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:48:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338643533376333', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:48:46 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'flavor' on Instance uuid 4695a204-a297-4971-bb38-2229dbba7a06 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:48:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:48:46 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:48:46 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:48:46 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:48:46 user nova-compute[73068]:   <serial>5f0d3b95-6a20-4c59-9fe6-5bd535726501</serial>
Aug 26 11:48:46 user nova-compute[73068]: </disk>
Aug 26 11:48:46 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:48:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:48:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:48:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No VIF found with MAC fa:16:3e:ef:4a:ff, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:48:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e0f983d8-b2a0-466d-9fe7-15f960afcb78 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.450s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050527.1894736, 2011f764-7057-43ba-ba00-834376cc968e => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:48:47 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] VM Resumed (Lifecycle Event)
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:48:47 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Instance spawned successfully.
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-fb80ea33-2053-4352-bcb2-93bd53b40f32 req-6fd642c1-de20-461c-81e8-0c953e354eb2 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Received event network-vif-plugged-78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fb80ea33-2053-4352-bcb2-93bd53b40f32 req-6fd642c1-de20-461c-81e8-0c953e354eb2 service nova] Acquiring lock "2011f764-7057-43ba-ba00-834376cc968e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fb80ea33-2053-4352-bcb2-93bd53b40f32 req-6fd642c1-de20-461c-81e8-0c953e354eb2 service nova] Lock "2011f764-7057-43ba-ba00-834376cc968e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fb80ea33-2053-4352-bcb2-93bd53b40f32 req-6fd642c1-de20-461c-81e8-0c953e354eb2 service nova] Lock "2011f764-7057-43ba-ba00-834376cc968e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-fb80ea33-2053-4352-bcb2-93bd53b40f32 req-6fd642c1-de20-461c-81e8-0c953e354eb2 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] No waiting events found dispatching network-vif-plugged-78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:48:47 user nova-compute[73068]: WARNING nova.compute.manager [req-fb80ea33-2053-4352-bcb2-93bd53b40f32 req-6fd642c1-de20-461c-81e8-0c953e354eb2 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Received unexpected event network-vif-plugged-78c12ef4-3a49-41b6-8efd-1db50299574a for instance with vm_state building and task_state spawning.
Aug 26 11:48:47 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050527.191664, 2011f764-7057-43ba-ba00-834376cc968e => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:48:47 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] VM Started (Lifecycle Event)
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:48:47 user nova-compute[73068]: INFO nova.compute.manager [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Took 6.98 seconds to spawn the instance on the hypervisor.
Aug 26 11:48:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:48:47 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:48:47 user nova-compute[73068]: INFO nova.compute.manager [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Took 7.99 seconds to build instance.
Aug 26 11:48:47 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-43807c6b-e969-49b3-8ed0-7998d36ec4d4 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "2011f764-7057-43ba-ba00-834376cc968e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.683s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:47 user nova-compute[73068]: INFO nova.compute.manager [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Rebuilding instance
Aug 26 11:48:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:48:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-76711813-51f4-416d-8fe1-cba9f0afbafb req-96ca0058-9861-4000-ad58-e65875db6f4d service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-vif-unplugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-76711813-51f4-416d-8fe1-cba9f0afbafb req-96ca0058-9861-4000-ad58-e65875db6f4d service nova] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-76711813-51f4-416d-8fe1-cba9f0afbafb req-96ca0058-9861-4000-ad58-e65875db6f4d service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-76711813-51f4-416d-8fe1-cba9f0afbafb req-96ca0058-9861-4000-ad58-e65875db6f4d service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-76711813-51f4-416d-8fe1-cba9f0afbafb req-96ca0058-9861-4000-ad58-e65875db6f4d service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] No waiting events found dispatching network-vif-unplugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:48:48 user nova-compute[73068]: WARNING nova.compute.manager [req-76711813-51f4-416d-8fe1-cba9f0afbafb req-96ca0058-9861-4000-ad58-e65875db6f4d service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received unexpected event network-vif-unplugged-f4e85893-b8db-4042-9f14-8b4678f476ed for instance with vm_state active and task_state rebuilding.
Aug 26 11:48:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:49 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Instance destroyed successfully.
Aug 26 11:48:49 user nova-compute[73068]: INFO nova.compute.manager [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Detaching volume 5f0d3b95-6a20-4c59-9fe6-5bd535726501
Aug 26 11:48:49 user nova-compute[73068]: INFO nova.virt.block_device [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Attempting to driver detach volume 5f0d3b95-6a20-4c59-9fe6-5bd535726501 from mountpoint /dev/vdb
Aug 26 11:48:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Attempting to detach device vdb from instance 4695a204-a297-4971-bb38-2229dbba7a06 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:48:49 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:48:49 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:48:49 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:48:49 user nova-compute[73068]:   <serial>5f0d3b95-6a20-4c59-9fe6-5bd535726501</serial>
Aug 26 11:48:49 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:48:49 user nova-compute[73068]: </disk>
Aug 26 11:48:49 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:48:49 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully detached device vdb from instance 4695a204-a297-4971-bb38-2229dbba7a06 from the persistent domain config.
Aug 26 11:48:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTQPZfIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:48:49 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cc86ed-b4a6-4dab-ab85-eaff368b5d7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[098e05c1-f1d0-4a03-99f1-42d6a3ae4524]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:48:49 user nova-compute[73068]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:48:49 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:48:49 user nova-compute[73068]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:48:49 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb0434ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfe5490-90ac-409c-9ffd-2b5ec9da15e5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d262186a-7d5f-49bc-be2c-71f6a2895a97]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bc99b4-adbf-4b54-a069-52ec28ba1eac]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed43630-6640-4029-91ed-1e8d80fd1a70]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c52ee6c-d5b3-4a32-b291-30b354ed019b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[791cfb1d-dac1-43a4-8e61-7785252f30ca]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260]
Aug 26 11:48:49 user nova-compute[73068]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260] successful.
Aug 26 11:48:49 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[663af068-e9c3-4ffb-84f8-83d86d0f2d0a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== disconnect_volume: return (368ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:48:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG nova.compute.manager [req-4702e104-8c48-40fe-b86e-6695befa1e7a req-394da6ba-320c-4be5-835a-972a9964ec86 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4702e104-8c48-40fe-b86e-6695befa1e7a req-394da6ba-320c-4be5-835a-972a9964ec86 service nova] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4702e104-8c48-40fe-b86e-6695befa1e7a req-394da6ba-320c-4be5-835a-972a9964ec86 service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4702e104-8c48-40fe-b86e-6695befa1e7a req-394da6ba-320c-4be5-835a-972a9964ec86 service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG nova.compute.manager [req-4702e104-8c48-40fe-b86e-6695befa1e7a req-394da6ba-320c-4be5-835a-972a9964ec86 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] No waiting events found dispatching network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:48:50 user nova-compute[73068]: WARNING nova.compute.manager [req-4702e104-8c48-40fe-b86e-6695befa1e7a req-394da6ba-320c-4be5-835a-972a9964ec86 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received unexpected event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed for instance with vm_state active and task_state rebuilding.
Aug 26 11:48:50 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Instance destroyed successfully.
Aug 26 11:48:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2027283732',display_name='tempest-ServerActionsTestOtherA-server-1929852047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2027283732',id=28,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNV2C3yebI6gKAGrK2bOsWft5dAyRJojrWxRudnSObcF4K3jO7Gc7ds5KnSPXlJaAeGzxWh/3rn3+GJ58URmNE1RSJWK/aLf+iOgDbE0l7rHOETxDZ6AnrFe8HMnIA0Blw==',key_name='tempest-keypair-540704974',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:46:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-urrjz1w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:48:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=4695a204-a297-4971-bb38-2229dbba7a06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_vif [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4e85893-b8, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:50 user nova-compute[73068]: INFO os_vif [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8')
Aug 26 11:48:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTQPZfIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:48:50 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8949d1-2a12-44cd-adae-a0bb6d75087e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[78647a30-ab02-4b29-a2c0-4e8307c17451]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:48:50 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:48:50 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddbf836560>, {}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Disconnecting from: [] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== disconnect_volume: return (63ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:48:50 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Deleting instance files /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06_del
Aug 26 11:48:50 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Deletion of /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06_del complete
Aug 26 11:48:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:50 user nova-compute[73068]: INFO nova.virt.block_device [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Booting with volume 5f0d3b95-6a20-4c59-9fe6-5bd535726501 at /dev/vdb
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.volume.cinder [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Update attachment failed for attachment 3e0f5e1d-5422-41dd-af0c-85a93ab345ce. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 was not found.).). (HTTP 500) (Request-ID: req-9d7bd49d-5729-4f91-abee-554201420946) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 was not found.).). (HTTP 500) (Request-ID: req-9d7bd49d-5729-4f91-abee-554201420946)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Failed to attach 441329fb-b98c-40eb-98ba-10b3820d6e13 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 was not found.).). (HTTP 500) (Request-ID: req-9d7bd49d-5729-4f91-abee-554201420946)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Traceback (most recent call last):
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     ret_val = method(obj, context, *args, **kwargs)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     self._do_attach(context, instance, volume, volume_api,
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     self._volume_attach(context, volume, connector, instance,
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     connection_info = volume_api.attachment_update(
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     res = method(self, ctx, *args, **kwargs)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     with excutils.save_and_reraise_exception():
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     self.force_reraise()
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     raise self.value
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     return method.func(obj, *args, **kwargs)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     resp = self._update('/attachments/%s' % id, body)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     return self.request(url, method, **kwargs)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d]     raise exceptions.from_response(resp, body)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 was not found.).). (HTTP 500) (Request-ID: req-9d7bd49d-5729-4f91-abee-554201420946)
Aug 26 11:48:50 user nova-compute[73068]: ERROR nova.compute.manager [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] 
Aug 26 11:48:50 user nova-compute[73068]: DEBUG os_brick.utils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a69d35-5e44-4dc9-a9f9-52963fe21787]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f709442-621a-4962-98f0-80b11f305df3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d4ceb9-51eb-4b83-841c-127b4cf37316]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3893b505-9260-415f-ac32-128229f9b6b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.926s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:48:51 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:48:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d860c9-5405-424a-882c-5ac3b1248348]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG os_brick.utils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:48:51 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Updating existing volume attachment record: e92748ad-e047-4033-98f3-318dc7a2b1be {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server [None req-34adbe5c-4318-44a1-b488-d870c6953294 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 was not found.).). (HTTP 500) (Request-ID: req-9d7bd49d-5729-4f91-abee-554201420946)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:441329fb-b98c-40eb-98ba-10b3820d6e13/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 was not found.).). (HTTP 500) (Request-ID: req-9d7bd49d-5729-4f91-abee-554201420946)
Aug 26 11:48:51 user nova-compute[73068]: ERROR oslo_messaging.rpc.server 
Aug 26 11:48:53 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:48:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050519.4475503, a39507fb-9897-4e5d-8217-390785208d52 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:48:54 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: a39507fb-9897-4e5d-8217-390785208d52] VM Stopped (Lifecycle Event)
Aug 26 11:48:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e03b7b77-bd13-447a-abef-923f0226f2d6 None None] [instance: a39507fb-9897-4e5d-8217-390785208d52] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:48:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:48:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:48:57 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:48:57 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7786MB free_disk=25.427852630615234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance e1132a5d-535a-4e72-8d03-25ea977f0034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ffe8d8fe-cc8f-44ab-8b95-5db1772b724d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 41ef2264-c365-44ee-b4aa-8266e3537c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4695a204-a297-4971-bb38-2229dbba7a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8f7236c5-6af7-4f5e-9598-f712ecff61bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:48:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:48:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:48:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:48:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:48:58 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:48:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Updating instance_info_cache with network_info: [{"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:48:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:48:59 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:48:59 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:59 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:48:59 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:49:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:03 user nova-compute[73068]: DEBUG nova.compute.manager [req-cca784ec-92e5-45dd-8936-514c296793d9 req-5481c222-c352-4365-ac50-0d068de6e650 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received event network-changed-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:49:03 user nova-compute[73068]: DEBUG nova.compute.manager [req-cca784ec-92e5-45dd-8936-514c296793d9 req-5481c222-c352-4365-ac50-0d068de6e650 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Refreshing instance network info cache due to event network-changed-70dde5da-ec16-46da-a306-6adc396d5e7a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:49:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cca784ec-92e5-45dd-8936-514c296793d9 req-5481c222-c352-4365-ac50-0d068de6e650 service nova] Acquiring lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:49:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cca784ec-92e5-45dd-8936-514c296793d9 req-5481c222-c352-4365-ac50-0d068de6e650 service nova] Acquired lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:49:03 user nova-compute[73068]: DEBUG nova.network.neutron [req-cca784ec-92e5-45dd-8936-514c296793d9 req-5481c222-c352-4365-ac50-0d068de6e650 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Refreshing network info cache for port 70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050529.0118725, 4695a204-a297-4971-bb38-2229dbba7a06 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:49:04 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] VM Stopped (Lifecycle Event)
Aug 26 11:49:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-1e7aacfd-e209-4a33-9c0d-25189dc0edcb None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lazy-loading 'flavor' on Instance uuid 8f7236c5-6af7-4f5e-9598-f712ecff61bf {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:04 user nova-compute[73068]: INFO nova.compute.manager [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Attaching volume ab9b45b4-f223-4ecd-823b-6946e08c3197 to /dev/vdb
Aug 26 11:49:04 user nova-compute[73068]: DEBUG os_brick.utils [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[616c5755-3f9f-4f79-af50-be07a8e09ca3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07f2063-d3cd-4069-a5da-e54e063f16fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c65087d-07b2-428a-8352-af14d18bd710]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[590dbe6b-66df-4705-bda5-97cd0818b66b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:49:04 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Creating image(s)
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "/opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "/opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "/opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:49:04 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:49:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15555a6-95e5-4fe3-911f-3a2c788860cc]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG os_brick.utils [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] <== get_connector_properties: return (209ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:49:04 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Updating existing volume attachment record: 72a9e9e1-8347-47d0-a2fe-b9ea2226c790 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.216s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.306s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk 1073741824" returned: 0 in 0.073s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.388s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.218s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.network.neutron [req-cca784ec-92e5-45dd-8936-514c296793d9 req-5481c222-c352-4365-ac50-0d068de6e650 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Updated VIF entry in instance network info cache for port 70dde5da-ec16-46da-a306-6adc396d5e7a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.network.neutron [req-cca784ec-92e5-45dd-8936-514c296793d9 req-5481c222-c352-4365-ac50-0d068de6e650 service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Updating instance_info_cache with network_info: [{"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cca784ec-92e5-45dd-8936-514c296793d9 req-5481c222-c352-4365-ac50-0d068de6e650 service nova] Releasing lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Cannot resize image /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Ensure instance console log exists: /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Start _get_guest_xml network_info=[{"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'e92748ad-e047-4033-98f3-318dc7a2b1be', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTQPZfIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4695a204-a297-4971-bb38-2229dbba7a06', 'attached_at': '', 'detached_at': '', 'volume_id': '5f0d3b95-6a20-4c59-9fe6-5bd535726501', 'serial': '5f0d3b95-6a20-4c59-9fe6-5bd535726501'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:49:05 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 11:49:05 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.objects.instance [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4695a204-a297-4971-bb38-2229dbba7a06 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTQPZfIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:49:05 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 11:49:05 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:49:05 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 11:49:05 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:49:05 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:49:05 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:49:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9823c88-d88f-4a73-aa82-7234e3fda88f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:49:06 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7272e9c8-5def-4203-9ca6-53635bf50145]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501] added
Aug 26 11:49:06 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d8b0af-4df1-4e01-971c-1f4818698810]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e7ebd2-0e0b-4ccd-b1c0-0c7d8035fe78]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTQPZfIr {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTQPZfIr" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5643442-5a8e-408a-98a5-9b0adcda4280]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bTQPZfIr'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[29af4d84-e5f6-4e1f-8b21-e68c86e37fb5]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc456471-5e74-4e8a-b452-6b8a2c170d94]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:06 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:06 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d7655f-7e1e-4fff-88a9-d63d6dd662ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260]
Aug 26 11:49:06 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260] successful.
Aug 26 11:49:06 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f626fbb0-ded2-4014-9473-9654ac1a1039]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1390a6-f545-40c9-8477-372cb798c79b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:06 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:06 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:06 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:06 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a7a840-1a96-4ef3-ae9c-76a8703bfbcc]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:49:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTQPZfIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26338643533376333', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338643533376333', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2027283732',display_name='tempest-ServerActionsTestOtherA-server-1929852047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2027283732',id=28,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNV2C3yebI6gKAGrK2bOsWft5dAyRJojrWxRudnSObcF4K3jO7Gc7ds5KnSPXlJaAeGzxWh/3rn3+GJ58URmNE1RSJWK/aLf+iOgDbE0l7rHOETxDZ6AnrFe8HMnIA0Blw==',key_name='tempest-keypair-540704974',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:46:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-urrjz1w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:48:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=4695a204-a297-4971-bb38-2229dbba7a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:49:07 user nova-compute[73068]:   <uuid>4695a204-a297-4971-bb38-2229dbba7a06</uuid>
Aug 26 11:49:07 user nova-compute[73068]:   <name>instance-0000001c</name>
Aug 26 11:49:07 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:49:07 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:49:07 user nova-compute[73068]:   <metadata>
Aug 26 11:49:07 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:49:07 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:49:07 user nova-compute[73068]:       <nova:name>tempest-ServerActionsTestOtherA-server-1929852047</nova:name>
Aug 26 11:49:07 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:49:05</nova:creationTime>
Aug 26 11:49:07 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:49:07 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:49:07 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:49:07 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:49:07 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:49:07 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:49:07 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:49:07 user nova-compute[73068]:       <nova:owner>
Aug 26 11:49:07 user nova-compute[73068]:         <nova:user uuid="9dbdaab1cbb4446b8709fe4526c10317">tempest-ServerActionsTestOtherA-281587706-project-member</nova:user>
Aug 26 11:49:07 user nova-compute[73068]:         <nova:project uuid="b517fdd290f5457f99b6cc9423a809b5">tempest-ServerActionsTestOtherA-281587706</nova:project>
Aug 26 11:49:07 user nova-compute[73068]:       </nova:owner>
Aug 26 11:49:07 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:49:07 user nova-compute[73068]:       <nova:ports>
Aug 26 11:49:07 user nova-compute[73068]:         <nova:port uuid="f4e85893-b8db-4042-9f14-8b4678f476ed">
Aug 26 11:49:07 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 11:49:07 user nova-compute[73068]:         </nova:port>
Aug 26 11:49:07 user nova-compute[73068]:       </nova:ports>
Aug 26 11:49:07 user nova-compute[73068]:     </nova:instance>
Aug 26 11:49:07 user nova-compute[73068]:   </metadata>
Aug 26 11:49:07 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:49:07 user nova-compute[73068]:     <system>
Aug 26 11:49:07 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:49:07 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:49:07 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:49:07 user nova-compute[73068]:       <entry name="serial">4695a204-a297-4971-bb38-2229dbba7a06</entry>
Aug 26 11:49:07 user nova-compute[73068]:       <entry name="uuid">4695a204-a297-4971-bb38-2229dbba7a06</entry>
Aug 26 11:49:07 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:49:07 user nova-compute[73068]:     </system>
Aug 26 11:49:07 user nova-compute[73068]:   </sysinfo>
Aug 26 11:49:07 user nova-compute[73068]:   <os>
Aug 26 11:49:07 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:49:07 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:49:07 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:49:07 user nova-compute[73068]:   </os>
Aug 26 11:49:07 user nova-compute[73068]:   <features>
Aug 26 11:49:07 user nova-compute[73068]:     <acpi/>
Aug 26 11:49:07 user nova-compute[73068]:     <apic/>
Aug 26 11:49:07 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:49:07 user nova-compute[73068]:   </features>
Aug 26 11:49:07 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:49:07 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:49:07 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:49:07 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:49:07 user nova-compute[73068]:   </clock>
Aug 26 11:49:07 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:49:07 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:49:07 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:49:07 user nova-compute[73068]:   </cpu>
Aug 26 11:49:07 user nova-compute[73068]:   <devices>
Aug 26 11:49:07 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:49:07 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:49:07 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk"/>
Aug 26 11:49:07 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:49:07 user nova-compute[73068]:     </disk>
Aug 26 11:49:07 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:49:07 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:49:07 user nova-compute[73068]:       <source dev="/dev/sdc"/>
Aug 26 11:49:07 user nova-compute[73068]:       <target dev="vdb" bus="virtio"/>
Aug 26 11:49:07 user nova-compute[73068]:       <serial>5f0d3b95-6a20-4c59-9fe6-5bd535726501</serial>
Aug 26 11:49:07 user nova-compute[73068]:     </disk>
Aug 26 11:49:07 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:49:07 user nova-compute[73068]:       <mac address="fa:16:3e:ef:4a:ff"/>
Aug 26 11:49:07 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:49:07 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:49:07 user nova-compute[73068]:       <target dev="tapf4e85893-b8"/>
Aug 26 11:49:07 user nova-compute[73068]:     </interface>
Aug 26 11:49:07 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:49:07 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/console.log" append="off"/>
Aug 26 11:49:07 user nova-compute[73068]:     </serial>
Aug 26 11:49:07 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:49:07 user nova-compute[73068]:     <video>
Aug 26 11:49:07 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:49:07 user nova-compute[73068]:     </video>
Aug 26 11:49:07 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:49:07 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:49:07 user nova-compute[73068]:     </rng>
Aug 26 11:49:07 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:49:07 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:49:07 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:49:07 user nova-compute[73068]:     </memballoon>
Aug 26 11:49:07 user nova-compute[73068]:   </devices>
Aug 26 11:49:07 user nova-compute[73068]: </domain>
Aug 26 11:49:07 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2027283732',display_name='tempest-ServerActionsTestOtherA-server-1929852047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2027283732',id=28,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNV2C3yebI6gKAGrK2bOsWft5dAyRJojrWxRudnSObcF4K3jO7Gc7ds5KnSPXlJaAeGzxWh/3rn3+GJ58URmNE1RSJWK/aLf+iOgDbE0l7rHOETxDZ6AnrFe8HMnIA0Blw==',key_name='tempest-keypair-540704974',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:46:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-urrjz1w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:48:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=4695a204-a297-4971-bb38-2229dbba7a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG os_vif [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4e85893-b8, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4e85893-b8, col_values=(('external_ids', {'iface-id': 'f4e85893-b8db-4042-9f14-8b4678f476ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:4a:ff', 'vm-uuid': '4695a204-a297-4971-bb38-2229dbba7a06'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:07 user nova-compute[73068]: INFO os_vif [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8')
Aug 26 11:49:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:49:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No VIF found with MAC fa:16:3e:ef:4a:ff, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:49:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:49:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:10 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:49:10 user nova-compute[73068]: INFO nova.compute.claims [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Claim successful on node user
Aug 26 11:49:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:10 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:49:10 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:49:11 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.policy [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed16b9cc5d7545dc842e87d9cc7b234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb9735c89849778fdb45c0ac6928a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:49:11 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Creating image(s)
Aug 26 11:49:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "/opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "/opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "/opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "b866502646b8e9d98537d1c862b4e3efb9d1d5aa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "b866502646b8e9d98537d1c862b4e3efb9d1d5aa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050551.3312376, 4695a204-a297-4971-bb38-2229dbba7a06 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:49:11 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] VM Resumed (Lifecycle Event)
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:49:11 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Instance spawned successfully.
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:11 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 11:49:11 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050551.3328454, 4695a204-a297-4971-bb38-2229dbba7a06 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:49:11 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] VM Started (Lifecycle Event)
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa.part --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-851b57ec-3bc6-4ccc-9f0c-66ed24b46a56 req-593f72da-ceae-46ed-8325-f4071794393a service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-851b57ec-3bc6-4ccc-9f0c-66ed24b46a56 req-593f72da-ceae-46ed-8325-f4071794393a service nova] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-851b57ec-3bc6-4ccc-9f0c-66ed24b46a56 req-593f72da-ceae-46ed-8325-f4071794393a service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-851b57ec-3bc6-4ccc-9f0c-66ed24b46a56 req-593f72da-ceae-46ed-8325-f4071794393a service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-851b57ec-3bc6-4ccc-9f0c-66ed24b46a56 req-593f72da-ceae-46ed-8325-f4071794393a service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] No waiting events found dispatching network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:49:12 user nova-compute[73068]: WARNING nova.compute.manager [req-851b57ec-3bc6-4ccc-9f0c-66ed24b46a56 req-593f72da-ceae-46ed-8325-f4071794393a service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received unexpected event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed for instance with vm_state active and task_state rebuild_spawning.
Aug 26 11:49:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:49:12 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa.part --force-share --output=json" returned: 0 in 0.232s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG nova.virt.images [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] 32f3a7e6-1601-4431-83a7-3ec08c911826 was qcow2, converting to raw {{(pid=73068) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa.part /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa.converted {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG nova.objects.instance [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73068) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-399c0638-3c9d-4228-8d70-998ae3d85782 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.167s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa.part /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa.converted" returned: 0 in 0.359s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa.converted --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG nova.network.neutron [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Successfully created port: 790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa.converted --force-share --output=json" returned: 0 in 0.242s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "b866502646b8e9d98537d1c862b4e3efb9d1d5aa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.641s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa --force-share --output=json" returned: 0 in 0.220s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "b866502646b8e9d98537d1c862b4e3efb9d1d5aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "b866502646b8e9d98537d1c862b4e3efb9d1d5aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa --force-share --output=json" returned: 0 in 0.204s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa,backing_fmt=raw /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa,backing_fmt=raw /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk 1073741824" returned: 0 in 0.065s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "b866502646b8e9d98537d1c862b4e3efb9d1d5aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa --force-share --output=json" returned: 0 in 0.235s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-408ded22-560f-4df5-873d-c3d1c1fc54e0 req-be4cde40-4fae-4c71-818d-4fe6bdcc6f88 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-408ded22-560f-4df5-873d-c3d1c1fc54e0 req-be4cde40-4fae-4c71-818d-4fe6bdcc6f88 service nova] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-408ded22-560f-4df5-873d-c3d1c1fc54e0 req-be4cde40-4fae-4c71-818d-4fe6bdcc6f88 service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-408ded22-560f-4df5-873d-c3d1c1fc54e0 req-be4cde40-4fae-4c71-818d-4fe6bdcc6f88 service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-408ded22-560f-4df5-873d-c3d1c1fc54e0 req-be4cde40-4fae-4c71-818d-4fe6bdcc6f88 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] No waiting events found dispatching network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:49:13 user nova-compute[73068]: WARNING nova.compute.manager [req-408ded22-560f-4df5-873d-c3d1c1fc54e0 req-be4cde40-4fae-4c71-818d-4fe6bdcc6f88 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received unexpected event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed for instance with vm_state active and task_state None.
Aug 26 11:49:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Successfully updated port: 790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquired lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Cannot resize image /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Ensure instance console log exists: /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.network.neutron [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.network.neutron [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updating instance_info_cache with network_info: [{"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Releasing lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Instance network_info: |[{"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Start _get_guest_xml network_info=[{"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:49:07Z,direct_url=<?>,disk_format='qcow2',id=32f3a7e6-1601-4431-83a7-3ec08c911826,min_disk=0,min_ram=0,name='tempest-scenario-img--1250553888',owner='6dcb9735c89849778fdb45c0ac6928a8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:49:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '32f3a7e6-1601-4431-83a7-3ec08c911826'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:49:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:49:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:49:07Z,direct_url=<?>,disk_format='qcow2',id=32f3a7e6-1601-4431-83a7-3ec08c911826,min_disk=0,min_ram=0,name='tempest-scenario-img--1250553888',owner='6dcb9735c89849778fdb45c0ac6928a8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:49:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-122193301',display_name='tempest-TestMinimumBasicScenario-server-122193301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-122193301',id=32,image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc3zI5JUNvcSNmaG4QDVrBpzH2Bek6CKPWrLNw2QmEbE/LUlIGWW3yWWt7CUaBJssBVJFA23Lr08zPblAFeKLZhu9iz7PyHlE9IkHNFWPPicNXELowoEsGLXPtidOkX8w==',key_name='tempest-TestMinimumBasicScenario-576065042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcb9735c89849778fdb45c0ac6928a8',ramdisk_id='',reservation_id='r-q8q8q636',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-143892643',owner_user_name='tempest-TestMinimumBasicScenario-143892643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:49:11Z,user_data=None,user_id='ed16b9cc5d7545dc842e87d9cc7b234e',uuid=143fe7ef-b157-4cc0-84bf-f19ede2190ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converting VIF {"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.objects.instance [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'pci_devices' on Instance uuid 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:49:14 user nova-compute[73068]:   <uuid>143fe7ef-b157-4cc0-84bf-f19ede2190ab</uuid>
Aug 26 11:49:14 user nova-compute[73068]:   <name>instance-00000020</name>
Aug 26 11:49:14 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:49:14 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:49:14 user nova-compute[73068]:   <metadata>
Aug 26 11:49:14 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:49:14 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:49:14 user nova-compute[73068]:       <nova:name>tempest-TestMinimumBasicScenario-server-122193301</nova:name>
Aug 26 11:49:14 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:49:14</nova:creationTime>
Aug 26 11:49:14 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:49:14 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:49:14 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:49:14 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:49:14 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:49:14 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:49:14 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:49:14 user nova-compute[73068]:       <nova:owner>
Aug 26 11:49:14 user nova-compute[73068]:         <nova:user uuid="ed16b9cc5d7545dc842e87d9cc7b234e">tempest-TestMinimumBasicScenario-143892643-project-member</nova:user>
Aug 26 11:49:14 user nova-compute[73068]:         <nova:project uuid="6dcb9735c89849778fdb45c0ac6928a8">tempest-TestMinimumBasicScenario-143892643</nova:project>
Aug 26 11:49:14 user nova-compute[73068]:       </nova:owner>
Aug 26 11:49:14 user nova-compute[73068]:       <nova:root type="image" uuid="32f3a7e6-1601-4431-83a7-3ec08c911826"/>
Aug 26 11:49:14 user nova-compute[73068]:       <nova:ports>
Aug 26 11:49:14 user nova-compute[73068]:         <nova:port uuid="790e07ee-1860-4415-a671-7969034dc83f">
Aug 26 11:49:14 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 11:49:14 user nova-compute[73068]:         </nova:port>
Aug 26 11:49:14 user nova-compute[73068]:       </nova:ports>
Aug 26 11:49:14 user nova-compute[73068]:     </nova:instance>
Aug 26 11:49:14 user nova-compute[73068]:   </metadata>
Aug 26 11:49:14 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:49:14 user nova-compute[73068]:     <system>
Aug 26 11:49:14 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:49:14 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:49:14 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:49:14 user nova-compute[73068]:       <entry name="serial">143fe7ef-b157-4cc0-84bf-f19ede2190ab</entry>
Aug 26 11:49:14 user nova-compute[73068]:       <entry name="uuid">143fe7ef-b157-4cc0-84bf-f19ede2190ab</entry>
Aug 26 11:49:14 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:49:14 user nova-compute[73068]:     </system>
Aug 26 11:49:14 user nova-compute[73068]:   </sysinfo>
Aug 26 11:49:14 user nova-compute[73068]:   <os>
Aug 26 11:49:14 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:49:14 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:49:14 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:49:14 user nova-compute[73068]:   </os>
Aug 26 11:49:14 user nova-compute[73068]:   <features>
Aug 26 11:49:14 user nova-compute[73068]:     <acpi/>
Aug 26 11:49:14 user nova-compute[73068]:     <apic/>
Aug 26 11:49:14 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:49:14 user nova-compute[73068]:   </features>
Aug 26 11:49:14 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:49:14 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:49:14 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:49:14 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:49:14 user nova-compute[73068]:   </clock>
Aug 26 11:49:14 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:49:14 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:49:14 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:49:14 user nova-compute[73068]:   </cpu>
Aug 26 11:49:14 user nova-compute[73068]:   <devices>
Aug 26 11:49:14 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:49:14 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:49:14 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk"/>
Aug 26 11:49:14 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:49:14 user nova-compute[73068]:     </disk>
Aug 26 11:49:14 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:49:14 user nova-compute[73068]:       <mac address="fa:16:3e:ec:6f:59"/>
Aug 26 11:49:14 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:49:14 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:49:14 user nova-compute[73068]:       <target dev="tap790e07ee-18"/>
Aug 26 11:49:14 user nova-compute[73068]:     </interface>
Aug 26 11:49:14 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:49:14 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/console.log" append="off"/>
Aug 26 11:49:14 user nova-compute[73068]:     </serial>
Aug 26 11:49:14 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:49:14 user nova-compute[73068]:     <video>
Aug 26 11:49:14 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:49:14 user nova-compute[73068]:     </video>
Aug 26 11:49:14 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:49:14 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:49:14 user nova-compute[73068]:     </rng>
Aug 26 11:49:14 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:49:14 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:49:14 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:49:14 user nova-compute[73068]:     </memballoon>
Aug 26 11:49:14 user nova-compute[73068]:   </devices>
Aug 26 11:49:14 user nova-compute[73068]: </domain>
Aug 26 11:49:14 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-122193301',display_name='tempest-TestMinimumBasicScenario-server-122193301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-122193301',id=32,image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc3zI5JUNvcSNmaG4QDVrBpzH2Bek6CKPWrLNw2QmEbE/LUlIGWW3yWWt7CUaBJssBVJFA23Lr08zPblAFeKLZhu9iz7PyHlE9IkHNFWPPicNXELowoEsGLXPtidOkX8w==',key_name='tempest-TestMinimumBasicScenario-576065042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcb9735c89849778fdb45c0ac6928a8',ramdisk_id='',reservation_id='r-q8q8q636',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-143892643',owner_user_name='tempest-TestMinimumBasicScenario-143892643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:49:11Z,user_data=None,user_id='ed16b9cc5d7545dc842e87d9cc7b234e',uuid=143fe7ef-b157-4cc0-84bf-f19ede2190ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converting VIF {"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG os_vif [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap790e07ee-18, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap790e07ee-18, col_values=(('external_ids', {'iface-id': '790e07ee-1860-4415-a671-7969034dc83f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:6f:59', 'vm-uuid': '143fe7ef-b157-4cc0-84bf-f19ede2190ab'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:14 user nova-compute[73068]: INFO os_vif [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18')
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:49:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] No VIF found with MAC fa:16:3e:ec:6f:59, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:49:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-7b026955-0596-4b20-ac33-dfe44bc5479d req-47abf556-f95b-4e98-906c-4c3bc4390c8b service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-changed-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:49:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-7b026955-0596-4b20-ac33-dfe44bc5479d req-47abf556-f95b-4e98-906c-4c3bc4390c8b service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Refreshing instance network info cache due to event network-changed-790e07ee-1860-4415-a671-7969034dc83f. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:49:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b026955-0596-4b20-ac33-dfe44bc5479d req-47abf556-f95b-4e98-906c-4c3bc4390c8b service nova] Acquiring lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:49:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b026955-0596-4b20-ac33-dfe44bc5479d req-47abf556-f95b-4e98-906c-4c3bc4390c8b service nova] Acquired lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:49:15 user nova-compute[73068]: DEBUG nova.network.neutron [req-7b026955-0596-4b20-ac33-dfe44bc5479d req-47abf556-f95b-4e98-906c-4c3bc4390c8b service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Refreshing network info cache for port 790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-7b026955-0596-4b20-ac33-dfe44bc5479d req-47abf556-f95b-4e98-906c-4c3bc4390c8b service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updated VIF entry in instance network info cache for port 790e07ee-1860-4415-a671-7969034dc83f. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-7b026955-0596-4b20-ac33-dfe44bc5479d req-47abf556-f95b-4e98-906c-4c3bc4390c8b service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updating instance_info_cache with network_info: [{"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7b026955-0596-4b20-ac33-dfe44bc5479d req-47abf556-f95b-4e98-906c-4c3bc4390c8b service nova] Releasing lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-06f48df7-089d-4d9a-bede-8ede272237ed req-9a8ceffd-bd37-4ab3-9128-94d8150400ee service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-06f48df7-089d-4d9a-bede-8ede272237ed req-9a8ceffd-bd37-4ab3-9128-94d8150400ee service nova] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-06f48df7-089d-4d9a-bede-8ede272237ed req-9a8ceffd-bd37-4ab3-9128-94d8150400ee service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-06f48df7-089d-4d9a-bede-8ede272237ed req-9a8ceffd-bd37-4ab3-9128-94d8150400ee service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-06f48df7-089d-4d9a-bede-8ede272237ed req-9a8ceffd-bd37-4ab3-9128-94d8150400ee service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] No waiting events found dispatching network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:49:16 user nova-compute[73068]: WARNING nova.compute.manager [req-06f48df7-089d-4d9a-bede-8ede272237ed req-9a8ceffd-bd37-4ab3-9128-94d8150400ee service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received unexpected event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f for instance with vm_state building and task_state spawning.
Aug 26 11:49:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUlhbJQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:49:18 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:49:18 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:49:18 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d024c401-0fe0-41e6-a7cd-095cf07db8a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:49:18 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eb87c9-64b5-4d30-8117-4b4f3324dae3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197] added
Aug 26 11:49:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b15f3b5-000f-4897-aefc-c80ce67d7dab]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ae224-5504-4323-845a-b5c6d75e4d45]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zUlhbJQT {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zUlhbJQT" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a259d84c-5a6b-4bc8-9293-7884e9d30773]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zUlhbJQT'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1142d38-2fc2-408d-8468-635d7e583eef]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-17c78e76-aeb7-477c-a9e7-525d7cd95305 req-4d10b195-3bc3-4202-8a03-3d424b6f2055 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-17c78e76-aeb7-477c-a9e7-525d7cd95305 req-4d10b195-3bc3-4202-8a03-3d424b6f2055 service nova] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-17c78e76-aeb7-477c-a9e7-525d7cd95305 req-4d10b195-3bc3-4202-8a03-3d424b6f2055 service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-17c78e76-aeb7-477c-a9e7-525d7cd95305 req-4d10b195-3bc3-4202-8a03-3d424b6f2055 service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-17c78e76-aeb7-477c-a9e7-525d7cd95305 req-4d10b195-3bc3-4202-8a03-3d424b6f2055 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] No waiting events found dispatching network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:49:18 user nova-compute[73068]: WARNING nova.compute.manager [req-17c78e76-aeb7-477c-a9e7-525d7cd95305 req-4d10b195-3bc3-4202-8a03-3d424b6f2055 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received unexpected event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f for instance with vm_state building and task_state spawning.
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050558.8119762, 143fe7ef-b157-4cc0-84bf-f19ede2190ab => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:49:18 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] VM Resumed (Lifecycle Event)
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:49:18 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Instance spawned successfully.
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8aa421-51b3-4969-b443-1f702dd389e9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13b690d-2965-404c-b890-b91d569eeeef (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:18 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:18 user nova-compute[73068]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13b690d-2965-404c-b890-b91d569eeeef (non-flash)
Aug 26 11:49:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:18 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:18 user nova-compute[73068]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13b690d-2965-404c-b890-b91d569eeeef (non-flash)
Aug 26 11:49:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:49:18 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050558.814062, 143fe7ef-b157-4cc0-84bf-f19ede2190ab => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:49:18 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] VM Started (Lifecycle Event)
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d824e5f-2d3b-499f-9da0-51a49461cf2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197, portal: 172.16.0.220,3260]
Aug 26 11:49:18 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197, portal: 172.16.0.220,3260] successful.
Aug 26 11:49:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.127s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[add922e6-5c29-4a0a-865c-6d9e7cfef275]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4321111-82c2-41e3-a892-bd2b3bb7c88b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13b690d-2965-404c-b890-b91d569eeeef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:19 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:19 user nova-compute[73068]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13b690d-2965-404c-b890-b91d569eeeef (non-flash)
Aug 26 11:49:19 user nova-compute[73068]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 (non-flash)
Aug 26 11:49:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:19 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:19 user nova-compute[73068]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13b690d-2965-404c-b890-b91d569eeeef (non-flash)
Aug 26 11:49:19 user nova-compute[73068]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 (non-flash)
Aug 26 11:49:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.488s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:49:19 user nova-compute[73068]: INFO nova.compute.manager [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Took 7.81 seconds to spawn the instance on the hypervisor.
Aug 26 11:49:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:19 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:49:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9338df-f66f-4a44-ac27-4fb6304b8968]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:49:19 user nova-compute[73068]: INFO nova.compute.manager [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Took 8.74 seconds to build instance.
Aug 26 11:49:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53d9e6b2-1463-4d5c-9a86-7e2994c667ba tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.883s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUlhbJQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.520s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] <== connect_volume: return (1522ms) {'type': 'block', 'scsi_wwn': '26232666162663730', 'path': '/dev/sde'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232666162663730', 'path': '/dev/sde'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lazy-loading 'flavor' on Instance uuid 8f7236c5-6af7-4f5e-9598-f712ecff61bf {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:49:20 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:49:20 user nova-compute[73068]:   <source dev="/dev/sde"/>
Aug 26 11:49:20 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:49:20 user nova-compute[73068]:   <serial>ab9b45b4-f223-4ecd-823b-6946e08c3197</serial>
Aug 26 11:49:20 user nova-compute[73068]: </disk>
Aug 26 11:49:20 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] No VIF found with MAC fa:16:3e:8f:4e:82, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a774e8c9-1a3f-44bf-9505-a285f8b0c4e4 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.261s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:22 user nova-compute[73068]: INFO nova.compute.manager [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Detaching volume ab9b45b4-f223-4ecd-823b-6946e08c3197
Aug 26 11:49:22 user nova-compute[73068]: INFO nova.virt.block_device [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Attempting to driver detach volume ab9b45b4-f223-4ecd-823b-6946e08c3197 from mountpoint /dev/vdb
Aug 26 11:49:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Attempting to detach device vdb from instance 8f7236c5-6af7-4f5e-9598-f712ecff61bf from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:49:22 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:49:22 user nova-compute[73068]:   <source dev="/dev/sde"/>
Aug 26 11:49:22 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:49:22 user nova-compute[73068]:   <serial>ab9b45b4-f223-4ecd-823b-6946e08c3197</serial>
Aug 26 11:49:22 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:49:22 user nova-compute[73068]: </disk>
Aug 26 11:49:22 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:49:22 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Successfully detached device vdb from instance 8f7236c5-6af7-4f5e-9598-f712ecff61bf from the persistent domain config.
Aug 26 11:49:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f7236c5-6af7-4f5e-9598-f712ecff61bf from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:49:22 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:49:22 user nova-compute[73068]:   <source dev="/dev/sde"/>
Aug 26 11:49:22 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:49:22 user nova-compute[73068]:   <serial>ab9b45b4-f223-4ecd-823b-6946e08c3197</serial>
Aug 26 11:49:22 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:49:22 user nova-compute[73068]: </disk>
Aug 26 11:49:22 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050562.9055898, 8f7236c5-6af7-4f5e-9598-f712ecff61bf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f7236c5-6af7-4f5e-9598-f712ecff61bf {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:49:22 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Successfully detached device vdb from instance 8f7236c5-6af7-4f5e-9598-f712ecff61bf from the live domain config.
Aug 26 11:49:22 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUlhbJQT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:49:22 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:49:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f92b840-62c0-4d99-a915-28354ad1306a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e13b690d-2965-404c-b890-b91d569eeeef\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e88ddf-3d2d-4e42-8738-b60a307a2779]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13b690d-2965-404c-b890-b91d569eeeef (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:22 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:22 user nova-compute[73068]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13b690d-2965-404c-b890-b91d569eeeef (non-flash)
Aug 26 11:49:22 user nova-compute[73068]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 (non-flash)
Aug 26 11:49:22 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:22 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:22 user nova-compute[73068]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e13b690d-2965-404c-b890-b91d569eeeef (non-flash)
Aug 26 11:49:22 user nova-compute[73068]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 (non-flash)
Aug 26 11:49:22 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9028a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197'): ({'sde'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Removing single pathed devices sde {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:49:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed608054-503c-46a8-8eb6-92dce9dfcae4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9a126-0386-4777-aafd-af312b67d690]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Flushing IO for device /dev/sde {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[092593df-154f-49a2-be65-1631d39796d9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b184b7-c31d-4eec-8e3d-c727f27c6008]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] SCSI volumes sde have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e894d3-22bd-4dd4-bb96-bc265aa3e277]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21bdcd5-16b9-437c-8962-8d0ee3317b23]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197, portal: 172.16.0.220,3260]
Aug 26 11:49:23 user nova-compute[73068]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197, portal: 172.16.0.220,3260] successful.
Aug 26 11:49:23 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab9b45b4-f223-4ecd-823b-6946e08c3197 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca38642-0cef-467e-8ad1-fbe7c5e16430]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] <== disconnect_volume: return (332ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:49:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:49:24 user nova-compute[73068]: DEBUG nova.objects.instance [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lazy-loading 'flavor' on Instance uuid 8f7236c5-6af7-4f5e-9598-f712ecff61bf {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-eeaaa2f1-21cb-4e80-ab72-063c80bccedd tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.952s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-2982f991-c927-4726-a5bd-4f0b37dab758 req-26e35af7-5457-421c-bc23-be947882fa3e service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Received event network-changed-9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:49:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-2982f991-c927-4726-a5bd-4f0b37dab758 req-26e35af7-5457-421c-bc23-be947882fa3e service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Refreshing instance network info cache due to event network-changed-9c6d4515-118a-4781-b086-7949a264cd4a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:49:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2982f991-c927-4726-a5bd-4f0b37dab758 req-26e35af7-5457-421c-bc23-be947882fa3e service nova] Acquiring lock "refresh_cache-c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:49:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2982f991-c927-4726-a5bd-4f0b37dab758 req-26e35af7-5457-421c-bc23-be947882fa3e service nova] Acquired lock "refresh_cache-c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:49:32 user nova-compute[73068]: DEBUG nova.network.neutron [req-2982f991-c927-4726-a5bd-4f0b37dab758 req-26e35af7-5457-421c-bc23-be947882fa3e service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Refreshing network info cache for port 9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:49:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-2982f991-c927-4726-a5bd-4f0b37dab758 req-26e35af7-5457-421c-bc23-be947882fa3e service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Updated VIF entry in instance network info cache for port 9c6d4515-118a-4781-b086-7949a264cd4a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:49:34 user nova-compute[73068]: DEBUG nova.network.neutron [req-2982f991-c927-4726-a5bd-4f0b37dab758 req-26e35af7-5457-421c-bc23-be947882fa3e service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Updating instance_info_cache with network_info: [{"id": "9c6d4515-118a-4781-b086-7949a264cd4a", "address": "fa:16:3e:d8:fe:d4", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d4515-11", "ovs_interfaceid": "9c6d4515-118a-4781-b086-7949a264cd4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:49:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2982f991-c927-4726-a5bd-4f0b37dab758 req-26e35af7-5457-421c-bc23-be947882fa3e service nova] Releasing lock "refresh_cache-c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:49:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:35 user nova-compute[73068]: DEBUG nova.compute.manager [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:49:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:49:36 user nova-compute[73068]: INFO nova.compute.claims [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Claim successful on node user
Aug 26 11:49:36 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:49:36 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:49:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:49:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:49:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:49:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:49:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:49:36 user nova-compute[73068]: DEBUG nova.policy [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d8a761bf9474faba69a5ec80149f352', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96de3b4133bc4201880aba9e21a28a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:49:37 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Creating image(s)
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "/opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "/opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "/opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.229s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.242s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk 1073741824" returned: 0 in 0.067s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.199s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:37 user nova-compute[73068]: DEBUG nova.network.neutron [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Successfully created port: 62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Cannot resize image /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Ensure instance console log exists: /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Successfully updated port: 62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquired lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-8db31502-eca8-44e9-9ca1-da4ede703163 req-e4a2f877-5336-42c3-b508-2adf0a7b1248 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-changed-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-8db31502-eca8-44e9-9ca1-da4ede703163 req-e4a2f877-5336-42c3-b508-2adf0a7b1248 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Refreshing instance network info cache due to event network-changed-62239563-2e85-4db8-8f92-0485fa06150a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8db31502-eca8-44e9-9ca1-da4ede703163 req-e4a2f877-5336-42c3-b508-2adf0a7b1248 service nova] Acquiring lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'flavor' on Instance uuid c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:39 user nova-compute[73068]: INFO nova.compute.manager [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Attaching volume 361fcdc4-49fc-49a6-b870-e0b4a1e825b1 to /dev/vdb
Aug 26 11:49:39 user nova-compute[73068]: DEBUG os_brick.utils [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dc63f2-b027-477f-a116-3a0b407c89fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[734728dd-e407-4ab4-b4bc-365c806e6e87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e085a11-92c0-4c0f-a53d-9dd6308ab48e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d49cea-841e-4d43-906c-ad7925073a75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updating instance_info_cache with network_info: [{"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:49:39 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f428c3-679c-4305-8209-3e75accafea2]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG os_brick.utils [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Updating existing volume attachment record: f0daa1e3-b781-4f23-a2d6-690cc317ac2f {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Releasing lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Instance network_info: |[{"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8db31502-eca8-44e9-9ca1-da4ede703163 req-e4a2f877-5336-42c3-b508-2adf0a7b1248 service nova] Acquired lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.network.neutron [req-8db31502-eca8-44e9-9ca1-da4ede703163 req-e4a2f877-5336-42c3-b508-2adf0a7b1248 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Refreshing network info cache for port 62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Start _get_guest_xml network_info=[{"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:49:39 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:49:39 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1850753118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1850753118',id=33,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2bTtOMnBA0E9ByfcfjqnBCDKKUPPvavcXN6V6eQxo7XHCtmTz2XISYFzCxNiagA6aW7w+2vlggBv2Ifd+P4pu7sxD6fF/JsrU1wL0AE+Be9npfc5TuNnWDeorZOapMhw==',key_name='tempest-keypair-987617515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-wmhja631',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=79b917aa-38f6-455f-bd7b-acc1330e5d66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.objects.instance [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'pci_devices' on Instance uuid 79b917aa-38f6-455f-bd7b-acc1330e5d66 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:49:39 user nova-compute[73068]:   <uuid>79b917aa-38f6-455f-bd7b-acc1330e5d66</uuid>
Aug 26 11:49:39 user nova-compute[73068]:   <name>instance-00000021</name>
Aug 26 11:49:39 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:49:39 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:49:39 user nova-compute[73068]:   <metadata>
Aug 26 11:49:39 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:49:39 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:49:39 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1850753118</nova:name>
Aug 26 11:49:39 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:49:39</nova:creationTime>
Aug 26 11:49:39 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:49:39 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:49:39 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:49:39 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:49:39 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:49:39 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:49:39 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:49:39 user nova-compute[73068]:       <nova:owner>
Aug 26 11:49:39 user nova-compute[73068]:         <nova:user uuid="5d8a761bf9474faba69a5ec80149f352">tempest-AttachVolumeShelveTestJSON-273124191-project-member</nova:user>
Aug 26 11:49:39 user nova-compute[73068]:         <nova:project uuid="96de3b4133bc4201880aba9e21a28a6e">tempest-AttachVolumeShelveTestJSON-273124191</nova:project>
Aug 26 11:49:39 user nova-compute[73068]:       </nova:owner>
Aug 26 11:49:39 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:49:39 user nova-compute[73068]:       <nova:ports>
Aug 26 11:49:39 user nova-compute[73068]:         <nova:port uuid="62239563-2e85-4db8-8f92-0485fa06150a">
Aug 26 11:49:39 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 11:49:39 user nova-compute[73068]:         </nova:port>
Aug 26 11:49:39 user nova-compute[73068]:       </nova:ports>
Aug 26 11:49:39 user nova-compute[73068]:     </nova:instance>
Aug 26 11:49:39 user nova-compute[73068]:   </metadata>
Aug 26 11:49:39 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:49:39 user nova-compute[73068]:     <system>
Aug 26 11:49:39 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:49:39 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:49:39 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:49:39 user nova-compute[73068]:       <entry name="serial">79b917aa-38f6-455f-bd7b-acc1330e5d66</entry>
Aug 26 11:49:39 user nova-compute[73068]:       <entry name="uuid">79b917aa-38f6-455f-bd7b-acc1330e5d66</entry>
Aug 26 11:49:39 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:49:39 user nova-compute[73068]:     </system>
Aug 26 11:49:39 user nova-compute[73068]:   </sysinfo>
Aug 26 11:49:39 user nova-compute[73068]:   <os>
Aug 26 11:49:39 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:49:39 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:49:39 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:49:39 user nova-compute[73068]:   </os>
Aug 26 11:49:39 user nova-compute[73068]:   <features>
Aug 26 11:49:39 user nova-compute[73068]:     <acpi/>
Aug 26 11:49:39 user nova-compute[73068]:     <apic/>
Aug 26 11:49:39 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:49:39 user nova-compute[73068]:   </features>
Aug 26 11:49:39 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:49:39 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:49:39 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:49:39 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:49:39 user nova-compute[73068]:   </clock>
Aug 26 11:49:39 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:49:39 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:49:39 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:49:39 user nova-compute[73068]:   </cpu>
Aug 26 11:49:39 user nova-compute[73068]:   <devices>
Aug 26 11:49:39 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:49:39 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:49:39 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk"/>
Aug 26 11:49:39 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:49:39 user nova-compute[73068]:     </disk>
Aug 26 11:49:39 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:49:39 user nova-compute[73068]:       <mac address="fa:16:3e:4e:88:53"/>
Aug 26 11:49:39 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:49:39 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:49:39 user nova-compute[73068]:       <target dev="tap62239563-2e"/>
Aug 26 11:49:39 user nova-compute[73068]:     </interface>
Aug 26 11:49:39 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:49:39 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/console.log" append="off"/>
Aug 26 11:49:39 user nova-compute[73068]:     </serial>
Aug 26 11:49:39 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:49:39 user nova-compute[73068]:     <video>
Aug 26 11:49:39 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:49:39 user nova-compute[73068]:     </video>
Aug 26 11:49:39 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:49:39 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:49:39 user nova-compute[73068]:     </rng>
Aug 26 11:49:39 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:49:39 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:49:39 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:49:39 user nova-compute[73068]:     </memballoon>
Aug 26 11:49:39 user nova-compute[73068]:   </devices>
Aug 26 11:49:39 user nova-compute[73068]: </domain>
Aug 26 11:49:39 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1850753118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1850753118',id=33,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2bTtOMnBA0E9ByfcfjqnBCDKKUPPvavcXN6V6eQxo7XHCtmTz2XISYFzCxNiagA6aW7w+2vlggBv2Ifd+P4pu7sxD6fF/JsrU1wL0AE+Be9npfc5TuNnWDeorZOapMhw==',key_name='tempest-keypair-987617515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-wmhja631',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=79b917aa-38f6-455f-bd7b-acc1330e5d66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG os_vif [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62239563-2e, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62239563-2e, col_values=(('external_ids', {'iface-id': '62239563-2e85-4db8-8f92-0485fa06150a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:88:53', 'vm-uuid': '79b917aa-38f6-455f-bd7b-acc1330e5d66'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:39 user nova-compute[73068]: INFO os_vif [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e')
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] No VIF found with MAC fa:16:3e:4e:88:53, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.network.neutron [req-8db31502-eca8-44e9-9ca1-da4ede703163 req-e4a2f877-5336-42c3-b508-2adf0a7b1248 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updated VIF entry in instance network info cache for port 62239563-2e85-4db8-8f92-0485fa06150a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG nova.network.neutron [req-8db31502-eca8-44e9-9ca1-da4ede703163 req-e4a2f877-5336-42c3-b508-2adf0a7b1248 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updating instance_info_cache with network_info: [{"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:49:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8db31502-eca8-44e9-9ca1-da4ede703163 req-e4a2f877-5336-42c3-b508-2adf0a7b1248 service nova] Releasing lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:49:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-df57cb4c-e024-4f0b-aec1-3390a38c16f2 req-b88b906c-7b5a-4674-923d-d1800ef8ec7e service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:49:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-df57cb4c-e024-4f0b-aec1-3390a38c16f2 req-b88b906c-7b5a-4674-923d-d1800ef8ec7e service nova] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-df57cb4c-e024-4f0b-aec1-3390a38c16f2 req-b88b906c-7b5a-4674-923d-d1800ef8ec7e service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-df57cb4c-e024-4f0b-aec1-3390a38c16f2 req-b88b906c-7b5a-4674-923d-d1800ef8ec7e service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-df57cb4c-e024-4f0b-aec1-3390a38c16f2 req-b88b906c-7b5a-4674-923d-d1800ef8ec7e service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] No waiting events found dispatching network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:49:41 user nova-compute[73068]: WARNING nova.compute.manager [req-df57cb4c-e024-4f0b-aec1-3390a38c16f2 req-b88b906c-7b5a-4674-923d-d1800ef8ec7e service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received unexpected event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a for instance with vm_state building and task_state spawning.
Aug 26 11:49:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-4966da7e-544c-4df9-9215-b9373cc7fe3a req-d510bd8f-aa8e-40f3-b48c-3c9ff8323ca0 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4966da7e-544c-4df9-9215-b9373cc7fe3a req-d510bd8f-aa8e-40f3-b48c-3c9ff8323ca0 service nova] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4966da7e-544c-4df9-9215-b9373cc7fe3a req-d510bd8f-aa8e-40f3-b48c-3c9ff8323ca0 service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4966da7e-544c-4df9-9215-b9373cc7fe3a req-d510bd8f-aa8e-40f3-b48c-3c9ff8323ca0 service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-4966da7e-544c-4df9-9215-b9373cc7fe3a req-d510bd8f-aa8e-40f3-b48c-3c9ff8323ca0 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] No waiting events found dispatching network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:49:43 user nova-compute[73068]: WARNING nova.compute.manager [req-4966da7e-544c-4df9-9215-b9373cc7fe3a req-d510bd8f-aa8e-40f3-b48c-3c9ff8323ca0 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received unexpected event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a for instance with vm_state building and task_state spawning.
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050583.2043576, 79b917aa-38f6-455f-bd7b-acc1330e5d66 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:49:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] VM Resumed (Lifecycle Event)
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:49:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Instance spawned successfully.
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:49:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050583.2072694, 79b917aa-38f6-455f-bd7b-acc1330e5d66 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:49:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] VM Started (Lifecycle Event)
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:49:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:49:43 user nova-compute[73068]: INFO nova.compute.manager [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 26 11:49:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:49:43 user nova-compute[73068]: INFO nova.compute.manager [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Took 7.41 seconds to build instance.
Aug 26 11:49:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-149512bd-6c44-49c0-a254-9ae5be5d1e7d tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.534s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:49:49 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:50 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:49:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIjiLuhl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:49:51 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:49:51 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:49:51 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0c03eb-12f1-4348-a136-2b2676c34934]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:49:51 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a0d3a7-52e6-40c5-8033-961aead018e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1] added
Aug 26 11:49:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7e2e58-46b2-49fc-bd5c-679756f1c0dd]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2565a1f8-4484-4d9f-89d7-b33d208e6cb0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIjiLuhl {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIjiLuhl" returned: 0 in 0.035s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[700fb65b-15eb-40c3-a85d-c83d7b70c384]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sIjiLuhl'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[437052c3-3bdb-400e-9d14-e6d383fa36b6]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d20fe2-aca7-4515-83bf-9ab2ec06c7c0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:51 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:51 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b800419-7f82-4ef1-b370-9eb866227643]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1, portal: 172.16.0.220,3260]
Aug 26 11:49:51 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1, portal: 172.16.0.220,3260] successful.
Aug 26 11:49:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1ef274-a202-4396-a418-0de558055fc9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbfe85d-9de3-4725-a447-9592241a3baa]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:51 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:51 user nova-compute[73068]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)
Aug 26 11:49:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:51 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:51 user nova-compute[73068]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)
Aug 26 11:49:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:49:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0adfe6-f712-4cb0-ab6e-79c46235a37e]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:52 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:49:52 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:49:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquired lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:49:52 user nova-compute[73068]: DEBUG nova.network.neutron [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:49:52 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'info_cache' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:52 user nova-compute[73068]: DEBUG nova.objects.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIjiLuhl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23533346661613538', 'path': '/dev/sdd'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533346661613538', 'path': '/dev/sdd'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.objects.instance [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'flavor' on Instance uuid c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:49:53 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:49:53 user nova-compute[73068]:   <source dev="/dev/sdd"/>
Aug 26 11:49:53 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:49:53 user nova-compute[73068]:   <serial>361fcdc4-49fc-49a6-b870-e0b4a1e825b1</serial>
Aug 26 11:49:53 user nova-compute[73068]: </disk>
Aug 26 11:49:53 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.network.neutron [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Updating instance_info_cache with network_info: [{"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Releasing lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:49:53 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance destroyed successfully.
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'resources' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.objects.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1855087128',display_name='tempest-AttachVolumeTestJSON-server-1855087128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1855087128',id=26,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8/mwF03MO1idO5kBsZjsTp9Quy8BbKtqGmyu/n7Yopwmv48cZnAqzWvqSKmsD2RP5jFSLkf0tUc/twQBPAIG/iXiF3VVNSEjceHGc2pPBap5FwQEeGG3wjFrME3DLEA==',key_name='tempest-keypair-477742915',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-mdlqzffh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=41ef2264-c365-44ee-b4aa-8266e3537c73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_vif [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33fb27ef-8c, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:49:53 user nova-compute[73068]: INFO os_vif [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c')
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JofdKQiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:49:53 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bb8fd5-dd3f-4b10-978f-2acfad8a6263]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[07214827-f55d-462b-b870-d5040f59b07e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:53 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:53 user nova-compute[73068]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)
Aug 26 11:49:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:53 user nova-compute[73068]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:53 user nova-compute[73068]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)
Aug 26 11:49:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb44becb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c79484-47f2-47bf-8a8f-a3e9064b547c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56565be-0241-4f4d-8742-8388d574bf71]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f603ba1-f7f0-46e9-b86b-4caafbc35aaf]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5bb8a1-887c-4e73-8469-f22f715cb62e]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] No VIF found with MAC fa:16:3e:d8:fe:d4, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7010301c-2fef-4755-9c36-6d10e1fee65d]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1bf148-fd67-453d-a6e3-50bcb91b6553]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260]
Aug 26 11:49:53 user nova-compute[73068]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260] successful.
Aug 26 11:49:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a124bff-d13f-4f75-b621-493e037f73c2]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] <== disconnect_volume: return (344ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Start _get_guest_xml network_info=[{"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '3812b832-3be5-44ee-8fba-c76b1317e7c4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JofdKQiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '41ef2264-c365-44ee-b4aa-8266e3537c73', 'attached_at': '', 'detached_at': '', 'volume_id': '3e68939a-baa1-46a3-8377-41766a576bac', 'serial': '3e68939a-baa1-46a3-8377-41766a576bac'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'numa_topology' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.objects.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:49:53 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:49:53 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd268554-1f81-40db-974a-16bf6237a16b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.599s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'vcpu_model' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.objects.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JofdKQiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:49:53 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:49:53 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:49:53 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7d92b3-35d7-4a88-b057-1e89f336f405]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:49:53 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3874f2-637f-4f66-8e68-d979d77a0e45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac] added
Aug 26 11:49:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[22689f97-798c-4929-87aa-123828e8b2a5]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5708cc45-d866-4b0a-a69f-82011b001b0b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JofdKQiL {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JofdKQiL" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23d5d75-7666-41da-843b-873a81346179]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JofdKQiL'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9a1341-3c9f-4ea5-9e89-aec31f3de502]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69c0bfd-f7a8-4f3b-956e-2581420fecbe]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:54 user nova-compute[73068]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)
Aug 26 11:49:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:54 user nova-compute[73068]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)
Aug 26 11:49:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[994e092a-67bc-4c2d-8fcc-f95f4d67b38c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260]
Aug 26 11:49:54 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260] successful.
Aug 26 11:49:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[147aeb02-f96c-49b7-a291-68ef530755e0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2e64a8-08bc-425b-955e-ddecbe8e9ef3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:54 user nova-compute[73068]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)
Aug 26 11:49:54 user nova-compute[73068]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:54 user nova-compute[73068]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)
Aug 26 11:49:54 user nova-compute[73068]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b7efa9-d388-4c0e-b37b-4c865c2aaa66]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JofdKQiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:49:54 user nova-compute[73068]: INFO nova.compute.manager [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Detaching volume 361fcdc4-49fc-49a6-b870-e0b4a1e825b1
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:54 user nova-compute[73068]: INFO nova.virt.block_device [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Attempting to driver detach volume 361fcdc4-49fc-49a6-b870-e0b4a1e825b1 from mountpoint /dev/vdb
Aug 26 11:49:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Attempting to detach device vdb from instance c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:49:54 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:49:54 user nova-compute[73068]:   <source dev="/dev/sdd"/>
Aug 26 11:49:54 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:49:54 user nova-compute[73068]:   <serial>361fcdc4-49fc-49a6-b870-e0b4a1e825b1</serial>
Aug 26 11:49:54 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:49:54 user nova-compute[73068]: </disk>
Aug 26 11:49:54 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:49:54 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully detached device vdb from instance c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 from the persistent domain config.
Aug 26 11:49:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:49:54 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:49:54 user nova-compute[73068]:   <source dev="/dev/sdd"/>
Aug 26 11:49:54 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:49:54 user nova-compute[73068]:   <serial>361fcdc4-49fc-49a6-b870-e0b4a1e825b1</serial>
Aug 26 11:49:54 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:49:54 user nova-compute[73068]: </disk>
Aug 26 11:49:54 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23333306364373961', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333306364373961', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050595.272383, c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1855087128',display_name='tempest-AttachVolumeTestJSON-server-1855087128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1855087128',id=26,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8/mwF03MO1idO5kBsZjsTp9Quy8BbKtqGmyu/n7Yopwmv48cZnAqzWvqSKmsD2RP5jFSLkf0tUc/twQBPAIG/iXiF3VVNSEjceHGc2pPBap5FwQEeGG3wjFrME3DLEA==',key_name='tempest-keypair-477742915',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-mdlqzffh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=41ef2264-c365-44ee-b4aa-8266e3537c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'pci_devices' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:55 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully detached device vdb from instance c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 from the live domain config.
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.objects.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:49:55 user nova-compute[73068]:   <uuid>41ef2264-c365-44ee-b4aa-8266e3537c73</uuid>
Aug 26 11:49:55 user nova-compute[73068]:   <name>instance-0000001a</name>
Aug 26 11:49:55 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:49:55 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:49:55 user nova-compute[73068]:   <metadata>
Aug 26 11:49:55 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:49:55 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:49:55 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeTestJSON-server-1855087128</nova:name>
Aug 26 11:49:55 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:49:53</nova:creationTime>
Aug 26 11:49:55 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:49:55 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:49:55 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:49:55 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:49:55 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:49:55 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:49:55 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:49:55 user nova-compute[73068]:       <nova:owner>
Aug 26 11:49:55 user nova-compute[73068]:         <nova:user uuid="9f8285bc9bf348289c10e62f2179a266">tempest-AttachVolumeTestJSON-1485056682-project-member</nova:user>
Aug 26 11:49:55 user nova-compute[73068]:         <nova:project uuid="58a6670af78b4f6ea72a6d4bc4274c31">tempest-AttachVolumeTestJSON-1485056682</nova:project>
Aug 26 11:49:55 user nova-compute[73068]:       </nova:owner>
Aug 26 11:49:55 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:49:55 user nova-compute[73068]:       <nova:ports>
Aug 26 11:49:55 user nova-compute[73068]:         <nova:port uuid="33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea">
Aug 26 11:49:55 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 11:49:55 user nova-compute[73068]:         </nova:port>
Aug 26 11:49:55 user nova-compute[73068]:       </nova:ports>
Aug 26 11:49:55 user nova-compute[73068]:     </nova:instance>
Aug 26 11:49:55 user nova-compute[73068]:   </metadata>
Aug 26 11:49:55 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:49:55 user nova-compute[73068]:     <system>
Aug 26 11:49:55 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:49:55 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:49:55 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:49:55 user nova-compute[73068]:       <entry name="serial">41ef2264-c365-44ee-b4aa-8266e3537c73</entry>
Aug 26 11:49:55 user nova-compute[73068]:       <entry name="uuid">41ef2264-c365-44ee-b4aa-8266e3537c73</entry>
Aug 26 11:49:55 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:49:55 user nova-compute[73068]:     </system>
Aug 26 11:49:55 user nova-compute[73068]:   </sysinfo>
Aug 26 11:49:55 user nova-compute[73068]:   <os>
Aug 26 11:49:55 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:49:55 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:49:55 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:49:55 user nova-compute[73068]:   </os>
Aug 26 11:49:55 user nova-compute[73068]:   <features>
Aug 26 11:49:55 user nova-compute[73068]:     <acpi/>
Aug 26 11:49:55 user nova-compute[73068]:     <apic/>
Aug 26 11:49:55 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:49:55 user nova-compute[73068]:   </features>
Aug 26 11:49:55 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:49:55 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:49:55 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:49:55 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:49:55 user nova-compute[73068]:   </clock>
Aug 26 11:49:55 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:49:55 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:49:55 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:49:55 user nova-compute[73068]:   </cpu>
Aug 26 11:49:55 user nova-compute[73068]:   <devices>
Aug 26 11:49:55 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:49:55 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:49:55 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk"/>
Aug 26 11:49:55 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:49:55 user nova-compute[73068]:     </disk>
Aug 26 11:49:55 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:49:55 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:49:55 user nova-compute[73068]:       <source dev="/dev/sdb"/>
Aug 26 11:49:55 user nova-compute[73068]:       <target dev="vdb" bus="virtio"/>
Aug 26 11:49:55 user nova-compute[73068]:       <serial>3e68939a-baa1-46a3-8377-41766a576bac</serial>
Aug 26 11:49:55 user nova-compute[73068]:     </disk>
Aug 26 11:49:55 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:49:55 user nova-compute[73068]:       <mac address="fa:16:3e:eb:08:a7"/>
Aug 26 11:49:55 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:49:55 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:49:55 user nova-compute[73068]:       <target dev="tap33fb27ef-8c"/>
Aug 26 11:49:55 user nova-compute[73068]:     </interface>
Aug 26 11:49:55 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:49:55 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/console.log" append="off"/>
Aug 26 11:49:55 user nova-compute[73068]:     </serial>
Aug 26 11:49:55 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:49:55 user nova-compute[73068]:     <video>
Aug 26 11:49:55 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:49:55 user nova-compute[73068]:     </video>
Aug 26 11:49:55 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:49:55 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:49:55 user nova-compute[73068]:     </rng>
Aug 26 11:49:55 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:49:55 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:49:55 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:49:55 user nova-compute[73068]:     </memballoon>
Aug 26 11:49:55 user nova-compute[73068]:   </devices>
Aug 26 11:49:55 user nova-compute[73068]: </domain>
Aug 26 11:49:55 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIjiLuhl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:49:55 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cda986f-37d8-43b6-8efb-fe656c74ce0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf82a839-3a4f-4495-9c08-3a6bf89114d5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:55 user nova-compute[73068]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)
Aug 26 11:49:55 user nova-compute[73068]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:49:55 user nova-compute[73068]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 (non-flash)
Aug 26 11:49:55 user nova-compute[73068]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:49:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd905bfd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1'): ({'sdd'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Removing single pathed devices sdd {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:49:55 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid '41ef2264-c365-44ee-b4aa-8266e3537c73' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid '41ef2264-c365-44ee-b4aa-8266e3537c73' (instance-0000001a)
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a8de71-7c1c-4da7-a77c-974a16d68c6e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e056dbde-fd67-4d86-b0af-edd0c182743f]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Flushing IO for device /dev/sdd {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf521649-c04f-4de6-8826-153f52782edc]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f50f1a-5912-4e7c-bd65-a202725d25fa]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ddb4fc-4330-4081-ab23-fc12ab699688]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[df99a26d-71c8-4013-904c-9e56f8550e1c]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1, portal: 172.16.0.220,3260]
Aug 26 11:49:55 user nova-compute[73068]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1, portal: 172.16.0.220,3260] successful.
Aug 26 11:49:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'trusted_certs' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.objects.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:361fcdc4-49fc-49a6-b870-e0b4a1e825b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d981f2f-6ff6-4655-9628-1c6742d8ccc2]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] <== disconnect_volume: return (437ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.210s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Cannot resize image /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'migration_context' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG nova.objects.base [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1855087128',display_name='tempest-AttachVolumeTestJSON-server-1855087128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1855087128',id=26,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8/mwF03MO1idO5kBsZjsTp9Quy8BbKtqGmyu/n7Yopwmv48cZnAqzWvqSKmsD2RP5jFSLkf0tUc/twQBPAIG/iXiF3VVNSEjceHGc2pPBap5FwQEeGG3wjFrME3DLEA==',key_name='tempest-keypair-477742915',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-mdlqzffh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:48:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=41ef2264-c365-44ee-b4aa-8266e3537c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG os_vif [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33fb27ef-8c, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33fb27ef-8c, col_values=(('external_ids', {'iface-id': '33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:08:a7', 'vm-uuid': '41ef2264-c365-44ee-b4aa-8266e3537c73'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:49:56 user nova-compute[73068]: INFO os_vif [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c')
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG nova.objects.instance [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'flavor' on Instance uuid c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f61b2f8-7ce2-434e-8549-001442403d4b tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.195s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:49:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:49:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050600.0621145, 41ef2264-c365-44ee-b4aa-8266e3537c73 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:50:00 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] VM Resumed (Lifecycle Event)
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-8a328580-cde2-41c6-9d82-ef2822b33c48 req-a6cf9397-54c3-404f-bee7-48cea0f82e26 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8a328580-cde2-41c6-9d82-ef2822b33c48 req-a6cf9397-54c3-404f-bee7-48cea0f82e26 service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8a328580-cde2-41c6-9d82-ef2822b33c48 req-a6cf9397-54c3-404f-bee7-48cea0f82e26 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8a328580-cde2-41c6-9d82-ef2822b33c48 req-a6cf9397-54c3-404f-bee7-48cea0f82e26 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-8a328580-cde2-41c6-9d82-ef2822b33c48 req-a6cf9397-54c3-404f-bee7-48cea0f82e26 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:50:00 user nova-compute[73068]: WARNING nova.compute.manager [req-8a328580-cde2-41c6-9d82-ef2822b33c48 req-a6cf9397-54c3-404f-bee7-48cea0f82e26 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received unexpected event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with vm_state stopped and task_state powering-on.
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-a7ae0133-fa52-4ae5-b6d5-b4a0a051ec9f req-8eb04070-1ab6-4408-bc4a-9f8529ddcb90 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a7ae0133-fa52-4ae5-b6d5-b4a0a051ec9f req-8eb04070-1ab6-4408-bc4a-9f8529ddcb90 service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a7ae0133-fa52-4ae5-b6d5-b4a0a051ec9f req-8eb04070-1ab6-4408-bc4a-9f8529ddcb90 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a7ae0133-fa52-4ae5-b6d5-b4a0a051ec9f req-8eb04070-1ab6-4408-bc4a-9f8529ddcb90 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-a7ae0133-fa52-4ae5-b6d5-b4a0a051ec9f req-8eb04070-1ab6-4408-bc4a-9f8529ddcb90 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:50:00 user nova-compute[73068]: WARNING nova.compute.manager [req-a7ae0133-fa52-4ae5-b6d5-b4a0a051ec9f req-8eb04070-1ab6-4408-bc4a-9f8529ddcb90 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received unexpected event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with vm_state stopped and task_state powering-on.
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:50:00 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance rebooted successfully.
Aug 26 11:50:00 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:50:00 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7445MB free_disk=25.26727294921875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-1a04a2ae-40af-490a-b4ce-116ab3b5d644 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:50:00 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050600.0642686, 41ef2264-c365-44ee-b4aa-8266e3537c73 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:50:00 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] VM Started (Lifecycle Event)
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:50:00 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance e1132a5d-535a-4e72-8d03-25ea977f0034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ffe8d8fe-cc8f-44ab-8b95-5db1772b724d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 41ef2264-c365-44ee-b4aa-8266e3537c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4695a204-a297-4971-bb38-2229dbba7a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8f7236c5-6af7-4f5e-9598-f712ecff61bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 143fe7ef-b157-4cc0-84bf-f19ede2190ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 79b917aa-38f6-455f-bd7b-acc1330e5d66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:00 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:50:01 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:50:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:50:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:50:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:50:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:50:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 11:50:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:50:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:50:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:50:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-7859f944-2b2e-4d2a-b7b7-c4517a9ca24d req-a8766988-58ae-4ba6-83c3-1e86b304039f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received event network-changed-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-7859f944-2b2e-4d2a-b7b7-c4517a9ca24d req-a8766988-58ae-4ba6-83c3-1e86b304039f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Refreshing instance network info cache due to event network-changed-70dde5da-ec16-46da-a306-6adc396d5e7a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7859f944-2b2e-4d2a-b7b7-c4517a9ca24d req-a8766988-58ae-4ba6-83c3-1e86b304039f service nova] Acquiring lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7859f944-2b2e-4d2a-b7b7-c4517a9ca24d req-a8766988-58ae-4ba6-83c3-1e86b304039f service nova] Acquired lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG nova.network.neutron [req-7859f944-2b2e-4d2a-b7b7-c4517a9ca24d req-a8766988-58ae-4ba6-83c3-1e86b304039f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Refreshing network info cache for port 70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:13 user nova-compute[73068]: INFO nova.compute.manager [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Terminating instance
Aug 26 11:50:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-7859f944-2b2e-4d2a-b7b7-c4517a9ca24d req-a8766988-58ae-4ba6-83c3-1e86b304039f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Updated VIF entry in instance network info cache for port 70dde5da-ec16-46da-a306-6adc396d5e7a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-7859f944-2b2e-4d2a-b7b7-c4517a9ca24d req-a8766988-58ae-4ba6-83c3-1e86b304039f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Updating instance_info_cache with network_info: [{"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:50:14 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Instance destroyed successfully.
Aug 26 11:50:14 user nova-compute[73068]: DEBUG nova.objects.instance [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lazy-loading 'resources' on Instance uuid 8f7236c5-6af7-4f5e-9598-f712ecff61bf {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7859f944-2b2e-4d2a-b7b7-c4517a9ca24d req-a8766988-58ae-4ba6-83c3-1e86b304039f service nova] Releasing lock "refresh_cache-8f7236c5-6af7-4f5e-9598-f712ecff61bf" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:47:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1243241120',display_name='tempest-TestStampPattern-server-1243241120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1243241120',id=29,image_ref='2a70afd8-34e5-44c3-a1ff-5b4a79beed80',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOjIwqwXxhj4vuR2faSe2o8BRRzkGgGBvS9L7RYqQe1LIPQbk27huMlBAllDlAQDoNhcMEO2Wm63f3TZ8pj6Qh31l00NncZ1Xwq8mt78Mf8ZGjfLHAOGzP1lCwxVTzSgw==',key_name='tempest-TestStampPattern-1601462936',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:47:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83dda8fc35fe4c4e95a5ac4cbbb387bf',ramdisk_id='',reservation_id='r-cueikmxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e1132a5d-535a-4e72-8d03-25ea977f0034',image_min_disk='1',image_min_ram='0',image_owner_id='83dda8fc35fe4c4e95a5ac4cbbb387bf',image_owner_project_name='tempest-TestStampPattern-2020058093',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2020058093-project-member',image_user_id='4680b32bdaef44f1a95e94447a9cf3ba',owner_project_name='tempest-TestStampPattern-2020058093',owner_user_name='tempest-TestStampPattern-2020058093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:47:18Z,user_data=None,user_id='4680b32bdaef44f1a95e94447a9cf3ba',uuid=8f7236c5-6af7-4f5e-9598-f712ecff61bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converting VIF {"id": "70dde5da-ec16-46da-a306-6adc396d5e7a", "address": "fa:16:3e:8f:4e:82", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70dde5da-ec", "ovs_interfaceid": "70dde5da-ec16-46da-a306-6adc396d5e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4e:82,bridge_name='br-int',has_traffic_filtering=True,id=70dde5da-ec16-46da-a306-6adc396d5e7a,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dde5da-ec') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG os_vif [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4e:82,bridge_name='br-int',has_traffic_filtering=True,id=70dde5da-ec16-46da-a306-6adc396d5e7a,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dde5da-ec') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70dde5da-ec, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:14 user nova-compute[73068]: INFO os_vif [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4e:82,bridge_name='br-int',has_traffic_filtering=True,id=70dde5da-ec16-46da-a306-6adc396d5e7a,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70dde5da-ec')
Aug 26 11:50:14 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Deleting instance files /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf_del
Aug 26 11:50:14 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Deletion of /opt/stack/data/nova/instances/8f7236c5-6af7-4f5e-9598-f712ecff61bf_del complete
Aug 26 11:50:14 user nova-compute[73068]: INFO nova.compute.manager [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 11:50:14 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:50:14 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:50:14 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Took 0.61 seconds to deallocate network for instance.
Aug 26 11:50:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received event network-vif-unplugged-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] Acquiring lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] No waiting events found dispatching network-vif-unplugged-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:50:15 user nova-compute[73068]: WARNING nova.compute.manager [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received unexpected event network-vif-unplugged-70dde5da-ec16-46da-a306-6adc396d5e7a for instance with vm_state deleted and task_state None.
Aug 26 11:50:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received event network-vif-plugged-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] Acquiring lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] No waiting events found dispatching network-vif-plugged-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:50:15 user nova-compute[73068]: WARNING nova.compute.manager [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received unexpected event network-vif-plugged-70dde5da-ec16-46da-a306-6adc396d5e7a for instance with vm_state deleted and task_state None.
Aug 26 11:50:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-7cb5c630-60e8-4d42-baa3-ade35337daf3 req-8e71c1fa-44fe-417b-a5cc-8a07c5bedf1f service nova] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Received event network-vif-deleted-70dde5da-ec16-46da-a306-6adc396d5e7a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:15 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Deleted allocations for instance 8f7236c5-6af7-4f5e-9598-f712ecff61bf
Aug 26 11:50:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8660b918-769b-4180-b236-1f758b4f3c11 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "8f7236c5-6af7-4f5e-9598-f712ecff61bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.175s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:29 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050614.2067053, 8f7236c5-6af7-4f5e-9598-f712ecff61bf => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:50:29 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] VM Stopped (Lifecycle Event)
Aug 26 11:50:29 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8870b654-6055-49b3-ac46-7ff175835c55 None None] [instance: 8f7236c5-6af7-4f5e-9598-f712ecff61bf] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:50:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:29 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:50:29 user nova-compute[73068]: INFO nova.compute.manager [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] instance snapshotting
Aug 26 11:50:29 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Beginning live snapshot process
Aug 26 11:50:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json -f qcow2 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json -f qcow2 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp95tsv6dv/49d4b7050b694fcc826dc07e081c9345.delta 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp95tsv6dv/49d4b7050b694fcc826dc07e081c9345.delta 1073741824" returned: 0 in 0.054s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 11:50:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73068) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 11:50:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73068) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 11:50:31 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 11:50:31 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:50:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp95tsv6dv/49d4b7050b694fcc826dc07e081c9345.delta /opt/stack/data/nova/instances/snapshots/tmp95tsv6dv/49d4b7050b694fcc826dc07e081c9345 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp95tsv6dv/49d4b7050b694fcc826dc07e081c9345.delta /opt/stack/data/nova/instances/snapshots/tmp95tsv6dv/49d4b7050b694fcc826dc07e081c9345" returned: 0 in 0.666s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:32 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Snapshot extracted, beginning image upload
Aug 26 11:50:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:35 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Snapshot image upload complete
Aug 26 11:50:35 user nova-compute[73068]: INFO nova.compute.manager [None req-ad77ca09-1798-4743-91c3-05ae79d3cd27 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Took 5.58 seconds to snapshot the instance on the hypervisor.
Aug 26 11:50:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:45 user nova-compute[73068]: INFO nova.compute.manager [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Terminating instance
Aug 26 11:50:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-465ac4c6-b504-4e6e-864b-540a6bfb62f5 req-e2e6b876-f0a9-4201-aff6-2f363eda800a service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Received event network-vif-unplugged-9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-465ac4c6-b504-4e6e-864b-540a6bfb62f5 req-e2e6b876-f0a9-4201-aff6-2f363eda800a service nova] Acquiring lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-465ac4c6-b504-4e6e-864b-540a6bfb62f5 req-e2e6b876-f0a9-4201-aff6-2f363eda800a service nova] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-465ac4c6-b504-4e6e-864b-540a6bfb62f5 req-e2e6b876-f0a9-4201-aff6-2f363eda800a service nova] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-465ac4c6-b504-4e6e-864b-540a6bfb62f5 req-e2e6b876-f0a9-4201-aff6-2f363eda800a service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] No waiting events found dispatching network-vif-unplugged-9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-465ac4c6-b504-4e6e-864b-540a6bfb62f5 req-e2e6b876-f0a9-4201-aff6-2f363eda800a service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Received event network-vif-unplugged-9c6d4515-118a-4781-b086-7949a264cd4a for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:50:45 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Instance destroyed successfully.
Aug 26 11:50:45 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lazy-loading 'resources' on Instance uuid c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:47:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-109383698',display_name='tempest-AttachVolumeNegativeTest-server-109383698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-109383698',id=30,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGIznN47Tlg4AQYgLVNXaLyq1oxRS8eUodpS+XnCivMddtx2a3LO2Rxcdi0X5ho40W/k40V6Qtif/QlFhWdkG9AZNg61fGunQ+GqpZrmZachcHp4KHcYkjQKOlat6Blsg==',key_name='tempest-keypair-808515825',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:47:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='770f7f84d7714f8d94971cae316c2215',ramdisk_id='',reservation_id='r-eyne02q1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1321002765',owner_user_name='tempest-AttachVolumeNegativeTest-1321002765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:47:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613022b47a2e40ca949864fa83fa2e73',uuid=c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c6d4515-118a-4781-b086-7949a264cd4a", "address": "fa:16:3e:d8:fe:d4", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d4515-11", "ovs_interfaceid": "9c6d4515-118a-4781-b086-7949a264cd4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converting VIF {"id": "9c6d4515-118a-4781-b086-7949a264cd4a", "address": "fa:16:3e:d8:fe:d4", "network": {"id": "27410c5d-3591-4563-9fa4-f8364c26bf3f", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1451942518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "770f7f84d7714f8d94971cae316c2215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c6d4515-11", "ovs_interfaceid": "9c6d4515-118a-4781-b086-7949a264cd4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fe:d4,bridge_name='br-int',has_traffic_filtering=True,id=9c6d4515-118a-4781-b086-7949a264cd4a,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d4515-11') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG os_vif [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fe:d4,bridge_name='br-int',has_traffic_filtering=True,id=9c6d4515-118a-4781-b086-7949a264cd4a,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d4515-11') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c6d4515-11, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:50:45 user nova-compute[73068]: INFO os_vif [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fe:d4,bridge_name='br-int',has_traffic_filtering=True,id=9c6d4515-118a-4781-b086-7949a264cd4a,network=Network(27410c5d-3591-4563-9fa4-f8364c26bf3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c6d4515-11')
Aug 26 11:50:45 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Deleting instance files /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54_del
Aug 26 11:50:45 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Deletion of /opt/stack/data/nova/instances/c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54_del complete
Aug 26 11:50:45 user nova-compute[73068]: INFO nova.compute.manager [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 26 11:50:45 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:50:45 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:50:46 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:50:46 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Took 0.97 seconds to deallocate network for instance.
Aug 26 11:50:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:47 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:50:47 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:50:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:47 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Deleted allocations for instance c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54
Aug 26 11:50:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3257cc9-cc27-46c8-a756-d7647f45df91 tempest-AttachVolumeNegativeTest-1321002765 tempest-AttachVolumeNegativeTest-1321002765-project-member] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.386s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-f72f0a12-7094-4ce2-8f2e-9dcb6c8faf75 req-65d3f6bf-12cc-4ff1-838e-9ee475bbe548 service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Received event network-vif-plugged-9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:50:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f72f0a12-7094-4ce2-8f2e-9dcb6c8faf75 req-65d3f6bf-12cc-4ff1-838e-9ee475bbe548 service nova] Acquiring lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f72f0a12-7094-4ce2-8f2e-9dcb6c8faf75 req-65d3f6bf-12cc-4ff1-838e-9ee475bbe548 service nova] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f72f0a12-7094-4ce2-8f2e-9dcb6c8faf75 req-65d3f6bf-12cc-4ff1-838e-9ee475bbe548 service nova] Lock "c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-f72f0a12-7094-4ce2-8f2e-9dcb6c8faf75 req-65d3f6bf-12cc-4ff1-838e-9ee475bbe548 service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] No waiting events found dispatching network-vif-plugged-9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:50:47 user nova-compute[73068]: WARNING nova.compute.manager [req-f72f0a12-7094-4ce2-8f2e-9dcb6c8faf75 req-65d3f6bf-12cc-4ff1-838e-9ee475bbe548 service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Received unexpected event network-vif-plugged-9c6d4515-118a-4781-b086-7949a264cd4a for instance with vm_state deleted and task_state None.
Aug 26 11:50:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-f72f0a12-7094-4ce2-8f2e-9dcb6c8faf75 req-65d3f6bf-12cc-4ff1-838e-9ee475bbe548 service nova] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Received event network-vif-deleted-9c6d4515-118a-4781-b086-7949a264cd4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:50:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:50:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:51 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:50:53 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:50:53 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:50:55 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:50:55 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:50:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:50:55 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:50:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:50:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:50:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:50:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:50:59 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:50:59 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7610MB free_disk=25.208484649658203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance e1132a5d-535a-4e72-8d03-25ea977f0034 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ffe8d8fe-cc8f-44ab-8b95-5db1772b724d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 41ef2264-c365-44ee-b4aa-8266e3537c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4695a204-a297-4971-bb38-2229dbba7a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 143fe7ef-b157-4cc0-84bf-f19ede2190ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 79b917aa-38f6-455f-bd7b-acc1330e5d66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:50:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:51:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:51:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:51:00 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050645.797817, c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:51:00 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] VM Stopped (Lifecycle Event)
Aug 26 11:51:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e049cd47-f58f-4dcb-aae6-5f31f662c24c None None] [instance: c7c35a1b-8b30-4a4b-9fa4-6e13f6d34d54] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:51:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:51:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:51:01 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:51:01 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:51:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:51:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:51:01 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:51:01 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid a11f0d98-3177-4345-8d54-b76b8a348f21 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:02 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updating instance_info_cache with network_info: [{"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:51:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:51:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:51:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:51:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:51:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:51:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG nova.objects.instance [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'flavor' on Instance uuid 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:06 user nova-compute[73068]: INFO nova.compute.manager [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Attaching volume 1cadcb13-566d-4205-9b20-d62a984f523d to /dev/vdb
Aug 26 11:51:06 user nova-compute[73068]: DEBUG os_brick.utils [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2fae3d-3d7c-4f73-bc60-ae8455cc3790]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[52810c90-268b-42df-8a5c-f718e8f59ff8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4486e4-c687-4e91-9447-9ccfff3ab66b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[564a4d33-3062-4fcb-bd14-609af02eaa68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:51:06 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:51:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2068928b-4f02-43ea-a3eb-c7c05b397f70]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG os_brick.utils [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:51:06 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updating existing volume attachment record: 8e3a2229-ea19-4bf8-bdd4-398ff42c94f3 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:51:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:51:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiTRztNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:51:18 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:51:18 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:51:18 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95b1940-76e6-4345-9691-cfc7f30305d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:51:18 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[05eee6b9-6c16-4af8-8bd2-ee792a438121]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d] added
Aug 26 11:51:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[011c580d-73cd-45d6-8118-4b2ee3111fef]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0203d0-6e88-405c-bdd7-9106b3acb19b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wiTRztNh {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wiTRztNh" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8658e917-db17-4ea5-80c7-260f1dedd749]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wiTRztNh'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4a4585-4684-4237-9613-f28569539b29]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb1577e-75d1-48eb-b838-869036114c4b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:51:18 user nova-compute[73068]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:51:18 user nova-compute[73068]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea80f90-bbc6-4702-b2d0-cd1b3e7687d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260]
Aug 26 11:51:18 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260] successful.
Aug 26 11:51:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[558dc4c0-67be-4c8b-8aef-83fb0febd333]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d450ab-0583-4aa5-ac1e-6cb1ed19fa84]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:51:18 user nova-compute[73068]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:18 user nova-compute[73068]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:51:18 user nova-compute[73068]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:18 user nova-compute[73068]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7edaa40-9a24-4aa2-8ea0-6713f779a160]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:51:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiTRztNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "e1132a5d-535a-4e72-8d03-25ea977f0034" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:19 user nova-compute[73068]: INFO nova.compute.manager [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Terminating instance
Aug 26 11:51:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-f974a96f-ac95-4175-b76f-c4bb806be477 req-62ce26a1-8834-4755-8326-eb61053dca9b service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received event network-changed-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-f974a96f-ac95-4175-b76f-c4bb806be477 req-62ce26a1-8834-4755-8326-eb61053dca9b service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Refreshing instance network info cache due to event network-changed-eaf16461-99d5-49ab-8498-476d74edd0bd. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f974a96f-ac95-4175-b76f-c4bb806be477 req-62ce26a1-8834-4755-8326-eb61053dca9b service nova] Acquiring lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f974a96f-ac95-4175-b76f-c4bb806be477 req-62ce26a1-8834-4755-8326-eb61053dca9b service nova] Acquired lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG nova.network.neutron [req-f974a96f-ac95-4175-b76f-c4bb806be477 req-62ce26a1-8834-4755-8326-eb61053dca9b service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Refreshing network info cache for port eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26165333631333564', 'path': '/dev/sdd'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165333631333564', 'path': '/dev/sdd'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG nova.objects.instance [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'flavor' on Instance uuid 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:51:19 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:51:19 user nova-compute[73068]:   <source dev="/dev/sdd"/>
Aug 26 11:51:19 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:51:19 user nova-compute[73068]:   <serial>1cadcb13-566d-4205-9b20-d62a984f523d</serial>
Aug 26 11:51:19 user nova-compute[73068]: </disk>
Aug 26 11:51:19 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG nova.network.neutron [req-f974a96f-ac95-4175-b76f-c4bb806be477 req-62ce26a1-8834-4755-8326-eb61053dca9b service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updated VIF entry in instance network info cache for port eaf16461-99d5-49ab-8498-476d74edd0bd. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG nova.network.neutron [req-f974a96f-ac95-4175-b76f-c4bb806be477 req-62ce26a1-8834-4755-8326-eb61053dca9b service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updating instance_info_cache with network_info: [{"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f974a96f-ac95-4175-b76f-c4bb806be477 req-62ce26a1-8834-4755-8326-eb61053dca9b service nova] Releasing lock "refresh_cache-e1132a5d-535a-4e72-8d03-25ea977f0034" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:20 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Instance destroyed successfully.
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.objects.instance [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lazy-loading 'resources' on Instance uuid e1132a5d-535a-4e72-8d03-25ea977f0034 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-453986594',display_name='tempest-TestStampPattern-server-453986594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-453986594',id=22,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOjIwqwXxhj4vuR2faSe2o8BRRzkGgGBvS9L7RYqQe1LIPQbk27huMlBAllDlAQDoNhcMEO2Wm63f3TZ8pj6Qh31l00NncZ1Xwq8mt78Mf8ZGjfLHAOGzP1lCwxVTzSgw==',key_name='tempest-TestStampPattern-1601462936',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:43:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83dda8fc35fe4c4e95a5ac4cbbb387bf',ramdisk_id='',reservation_id='r-e682eog0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2020058093',owner_user_name='tempest-TestStampPattern-2020058093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:47:08Z,user_data=None,user_id='4680b32bdaef44f1a95e94447a9cf3ba',uuid=e1132a5d-535a-4e72-8d03-25ea977f0034,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converting VIF {"id": "eaf16461-99d5-49ab-8498-476d74edd0bd", "address": "fa:16:3e:dd:4e:e4", "network": {"id": "15e970f3-0896-4237-bf83-da288884fb76", "bridge": "br-int", "label": "tempest-TestStampPattern-1246197615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83dda8fc35fe4c4e95a5ac4cbbb387bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaf16461-99", "ovs_interfaceid": "eaf16461-99d5-49ab-8498-476d74edd0bd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:4e:e4,bridge_name='br-int',has_traffic_filtering=True,id=eaf16461-99d5-49ab-8498-476d74edd0bd,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf16461-99') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG os_vif [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:4e:e4,bridge_name='br-int',has_traffic_filtering=True,id=eaf16461-99d5-49ab-8498-476d74edd0bd,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf16461-99') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaf16461-99, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:20 user nova-compute[73068]: INFO os_vif [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:4e:e4,bridge_name='br-int',has_traffic_filtering=True,id=eaf16461-99d5-49ab-8498-476d74edd0bd,network=Network(15e970f3-0896-4237-bf83-da288884fb76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeaf16461-99')
Aug 26 11:51:20 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Deleting instance files /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034_del
Aug 26 11:51:20 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Deletion of /opt/stack/data/nova/instances/e1132a5d-535a-4e72-8d03-25ea977f0034_del complete
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] No VIF found with MAC fa:16:3e:ec:6f:59, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:51:20 user nova-compute[73068]: INFO nova.compute.manager [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 26 11:51:20 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ab2de312-0640-4d9a-ae4f-c4bc9cd7635f tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.916s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.compute.manager [req-00f15a39-d82c-47b3-bd8e-2843bc34444b req-c6c49a47-8615-4d50-bf4d-abbf16e3c808 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received event network-vif-deleted-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:20 user nova-compute[73068]: INFO nova.compute.manager [req-00f15a39-d82c-47b3-bd8e-2843bc34444b req-c6c49a47-8615-4d50-bf4d-abbf16e3c808 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Neutron deleted interface eaf16461-99d5-49ab-8498-476d74edd0bd; detaching it from the instance and deleting it from the info cache
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.network.neutron [req-00f15a39-d82c-47b3-bd8e-2843bc34444b req-c6c49a47-8615-4d50-bf4d-abbf16e3c808 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:20 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Took 0.53 seconds to deallocate network for instance.
Aug 26 11:51:20 user nova-compute[73068]: DEBUG nova.compute.manager [req-00f15a39-d82c-47b3-bd8e-2843bc34444b req-c6c49a47-8615-4d50-bf4d-abbf16e3c808 service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Detach interface failed, port_id=eaf16461-99d5-49ab-8498-476d74edd0bd, reason: Instance e1132a5d-535a-4e72-8d03-25ea977f0034 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received event network-vif-unplugged-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] Acquiring lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] No waiting events found dispatching network-vif-unplugged-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:51:21 user nova-compute[73068]: WARNING nova.compute.manager [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received unexpected event network-vif-unplugged-eaf16461-99d5-49ab-8498-476d74edd0bd for instance with vm_state deleted and task_state None.
Aug 26 11:51:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received event network-vif-plugged-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] Acquiring lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] No waiting events found dispatching network-vif-plugged-eaf16461-99d5-49ab-8498-476d74edd0bd {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:51:21 user nova-compute[73068]: WARNING nova.compute.manager [req-dac24468-26d1-46f1-8c89-b31810da9bc4 req-d9811c8d-74be-43b4-8da6-e87bc53075ff service nova] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Received unexpected event network-vif-plugged-eaf16461-99d5-49ab-8498-476d74edd0bd for instance with vm_state deleted and task_state None.
Aug 26 11:51:21 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:51:21 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:51:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:21 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Deleted allocations for instance e1132a5d-535a-4e72-8d03-25ea977f0034
Aug 26 11:51:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2333ab57-b1e1-4760-997a-f544ebd45e30 tempest-TestStampPattern-2020058093 tempest-TestStampPattern-2020058093-project-member] Lock "e1132a5d-535a-4e72-8d03-25ea977f0034" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.264s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b551286-fb0b-4371-b2e0-e757be8a39c8 req-ff06846c-6926-4226-ac92-c4a38d7e32b9 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-changed-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b551286-fb0b-4371-b2e0-e757be8a39c8 req-ff06846c-6926-4226-ac92-c4a38d7e32b9 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Refreshing instance network info cache due to event network-changed-62239563-2e85-4db8-8f92-0485fa06150a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:51:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b551286-fb0b-4371-b2e0-e757be8a39c8 req-ff06846c-6926-4226-ac92-c4a38d7e32b9 service nova] Acquiring lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:51:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b551286-fb0b-4371-b2e0-e757be8a39c8 req-ff06846c-6926-4226-ac92-c4a38d7e32b9 service nova] Acquired lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:51:26 user nova-compute[73068]: DEBUG nova.network.neutron [req-0b551286-fb0b-4371-b2e0-e757be8a39c8 req-ff06846c-6926-4226-ac92-c4a38d7e32b9 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Refreshing network info cache for port 62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:51:27 user nova-compute[73068]: DEBUG nova.network.neutron [req-0b551286-fb0b-4371-b2e0-e757be8a39c8 req-ff06846c-6926-4226-ac92-c4a38d7e32b9 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updated VIF entry in instance network info cache for port 62239563-2e85-4db8-8f92-0485fa06150a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:51:27 user nova-compute[73068]: DEBUG nova.network.neutron [req-0b551286-fb0b-4371-b2e0-e757be8a39c8 req-ff06846c-6926-4226-ac92-c4a38d7e32b9 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updating instance_info_cache with network_info: [{"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b551286-fb0b-4371-b2e0-e757be8a39c8 req-ff06846c-6926-4226-ac92-c4a38d7e32b9 service nova] Releasing lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:51:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:51:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:51:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:51:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:51:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-01997ed1-7e83-4fae-89bc-fb9f8bfdee12 req-1e84e2bf-0028-4e8c-a8af-80cfa9f9a192 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-changed-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-01997ed1-7e83-4fae-89bc-fb9f8bfdee12 req-1e84e2bf-0028-4e8c-a8af-80cfa9f9a192 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Refreshing instance network info cache due to event network-changed-790e07ee-1860-4415-a671-7969034dc83f. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:51:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-01997ed1-7e83-4fae-89bc-fb9f8bfdee12 req-1e84e2bf-0028-4e8c-a8af-80cfa9f9a192 service nova] Acquiring lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:51:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-01997ed1-7e83-4fae-89bc-fb9f8bfdee12 req-1e84e2bf-0028-4e8c-a8af-80cfa9f9a192 service nova] Acquired lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:51:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-01997ed1-7e83-4fae-89bc-fb9f8bfdee12 req-1e84e2bf-0028-4e8c-a8af-80cfa9f9a192 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Refreshing network info cache for port 790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:51:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-01997ed1-7e83-4fae-89bc-fb9f8bfdee12 req-1e84e2bf-0028-4e8c-a8af-80cfa9f9a192 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updated VIF entry in instance network info cache for port 790e07ee-1860-4415-a671-7969034dc83f. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:51:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-01997ed1-7e83-4fae-89bc-fb9f8bfdee12 req-1e84e2bf-0028-4e8c-a8af-80cfa9f9a192 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updating instance_info_cache with network_info: [{"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-01997ed1-7e83-4fae-89bc-fb9f8bfdee12 req-1e84e2bf-0028-4e8c-a8af-80cfa9f9a192 service nova] Releasing lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:51:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:32 user nova-compute[73068]: INFO nova.compute.manager [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Shelving
Aug 26 11:51:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-75ce00d4-5aad-45d0-af6f-f47c146c2b0d req-99f731c2-adcb-4741-a37d-48bed20b301b service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-changed-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-75ce00d4-5aad-45d0-af6f-f47c146c2b0d req-99f731c2-adcb-4741-a37d-48bed20b301b service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Refreshing instance network info cache due to event network-changed-790e07ee-1860-4415-a671-7969034dc83f. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-75ce00d4-5aad-45d0-af6f-f47c146c2b0d req-99f731c2-adcb-4741-a37d-48bed20b301b service nova] Acquiring lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-75ce00d4-5aad-45d0-af6f-f47c146c2b0d req-99f731c2-adcb-4741-a37d-48bed20b301b service nova] Acquired lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-75ce00d4-5aad-45d0-af6f-f47c146c2b0d req-99f731c2-adcb-4741-a37d-48bed20b301b service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Refreshing network info cache for port 790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0fde0a5-1184-4608-a164-165463969482 req-c5aa80c6-acff-4092-b537-6d393e96830d service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-vif-unplugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0fde0a5-1184-4608-a164-165463969482 req-c5aa80c6-acff-4092-b537-6d393e96830d service nova] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0fde0a5-1184-4608-a164-165463969482 req-c5aa80c6-acff-4092-b537-6d393e96830d service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0fde0a5-1184-4608-a164-165463969482 req-c5aa80c6-acff-4092-b537-6d393e96830d service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0fde0a5-1184-4608-a164-165463969482 req-c5aa80c6-acff-4092-b537-6d393e96830d service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] No waiting events found dispatching network-vif-unplugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:51:33 user nova-compute[73068]: WARNING nova.compute.manager [req-c0fde0a5-1184-4608-a164-165463969482 req-c5aa80c6-acff-4092-b537-6d393e96830d service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received unexpected event network-vif-unplugged-62239563-2e85-4db8-8f92-0485fa06150a for instance with vm_state active and task_state shelving.
Aug 26 11:51:33 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Instance destroyed successfully.
Aug 26 11:51:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-75ce00d4-5aad-45d0-af6f-f47c146c2b0d req-99f731c2-adcb-4741-a37d-48bed20b301b service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updated VIF entry in instance network info cache for port 790e07ee-1860-4415-a671-7969034dc83f. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-75ce00d4-5aad-45d0-af6f-f47c146c2b0d req-99f731c2-adcb-4741-a37d-48bed20b301b service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updating instance_info_cache with network_info: [{"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-75ce00d4-5aad-45d0-af6f-f47c146c2b0d req-99f731c2-adcb-4741-a37d-48bed20b301b service nova] Releasing lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:51:33 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Beginning cold snapshot process
Aug 26 11:51:33 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:51:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk /opt/stack/data/nova/instances/snapshots/tmpvv3zcex_/abbd4cb500e94c8fa9e0dc342cc1c4d8 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk /opt/stack/data/nova/instances/snapshots/tmpvv3zcex_/abbd4cb500e94c8fa9e0dc342cc1c4d8" returned: 0 in 0.763s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Snapshot extracted, beginning image upload
Aug 26 11:51:35 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050680.176712, e1132a5d-535a-4e72-8d03-25ea977f0034 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:51:35 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] VM Stopped (Lifecycle Event)
Aug 26 11:51:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-d297a238-6c85-4687-b8e1-09b9599b58fb req-b1710afe-2fc1-43e7-8cbf-fca4b69b4781 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d297a238-6c85-4687-b8e1-09b9599b58fb req-b1710afe-2fc1-43e7-8cbf-fca4b69b4781 service nova] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d297a238-6c85-4687-b8e1-09b9599b58fb req-b1710afe-2fc1-43e7-8cbf-fca4b69b4781 service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d297a238-6c85-4687-b8e1-09b9599b58fb req-b1710afe-2fc1-43e7-8cbf-fca4b69b4781 service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-d297a238-6c85-4687-b8e1-09b9599b58fb req-b1710afe-2fc1-43e7-8cbf-fca4b69b4781 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] No waiting events found dispatching network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:51:35 user nova-compute[73068]: WARNING nova.compute.manager [req-d297a238-6c85-4687-b8e1-09b9599b58fb req-b1710afe-2fc1-43e7-8cbf-fca4b69b4781 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received unexpected event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 11:51:35 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b0d53394-006e-4fa1-8c65-7cb07c1e5e47 None None] [instance: e1132a5d-535a-4e72-8d03-25ea977f0034] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:51:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Snapshot image upload complete
Aug 26 11:51:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:51:36 user nova-compute[73068]: INFO nova.compute.manager [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Shelve offloading
Aug 26 11:51:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Instance destroyed successfully.
Aug 26 11:51:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:51:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:51:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquired lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:51:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:51:37 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updating instance_info_cache with network_info: [{"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Releasing lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:51:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:51:38 user nova-compute[73068]: INFO nova.compute.claims [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Claim successful on node user
Aug 26 11:51:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Instance destroyed successfully.
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'resources' on Instance uuid 79b917aa-38f6-455f-bd7b-acc1330e5d66 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1850753118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1850753118',id=33,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2bTtOMnBA0E9ByfcfjqnBCDKKUPPvavcXN6V6eQxo7XHCtmTz2XISYFzCxNiagA6aW7w+2vlggBv2Ifd+P4pu7sxD6fF/JsrU1wL0AE+Be9npfc5TuNnWDeorZOapMhw==',key_name='tempest-keypair-987617515',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:49:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-wmhja631',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member',shelved_at='2023-08-26T11:51:36.735473',shelved_host='user',shelved_image_id='4458bdc9-9e9b-43e2-88d7-9de5acde78c9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=79b917aa-38f6-455f-bd7b-acc1330e5d66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG os_vif [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62239563-2e, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-cfaa13d2-bfd1-4e28-8e68-1f19edd73706 req-3b2b31b4-10c7-4276-8756-4f85be0a4308 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-changed-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-cfaa13d2-bfd1-4e28-8e68-1f19edd73706 req-3b2b31b4-10c7-4276-8756-4f85be0a4308 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Refreshing instance network info cache due to event network-changed-62239563-2e85-4db8-8f92-0485fa06150a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cfaa13d2-bfd1-4e28-8e68-1f19edd73706 req-3b2b31b4-10c7-4276-8756-4f85be0a4308 service nova] Acquiring lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cfaa13d2-bfd1-4e28-8e68-1f19edd73706 req-3b2b31b4-10c7-4276-8756-4f85be0a4308 service nova] Acquired lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.network.neutron [req-cfaa13d2-bfd1-4e28-8e68-1f19edd73706 req-3b2b31b4-10c7-4276-8756-4f85be0a4308 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Refreshing network info cache for port 62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:51:38 user nova-compute[73068]: INFO os_vif [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e')
Aug 26 11:51:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Deleting instance files /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66_del
Aug 26 11:51:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Deletion of /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66_del complete
Aug 26 11:51:38 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Deleted allocations for instance 79b917aa-38f6-455f-bd7b-acc1330e5d66
Aug 26 11:51:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.140s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'numa_topology' on Instance uuid 79b917aa-38f6-455f-bd7b-acc1330e5d66 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.objects.base [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Object Instance<79b917aa-38f6-455f-bd7b-acc1330e5d66> lazy-loaded attributes: resources,numa_topology {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:51:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:51:38 user nova-compute[73068]: INFO nova.virt.block_device [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Booting with blank volume at /dev/vda
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.policy [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cd2bf96810a4540969277c8f94d5a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20a527043d44250bfe0a4b9dbf3e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b3086283-5531-45e2-bcfa-e70621c254a4 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.215s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.network.neutron [req-cfaa13d2-bfd1-4e28-8e68-1f19edd73706 req-3b2b31b4-10c7-4276-8756-4f85be0a4308 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updated VIF entry in instance network info cache for port 62239563-2e85-4db8-8f92-0485fa06150a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:51:38 user nova-compute[73068]: DEBUG nova.network.neutron [req-cfaa13d2-bfd1-4e28-8e68-1f19edd73706 req-3b2b31b4-10c7-4276-8756-4f85be0a4308 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updating instance_info_cache with network_info: [{"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap62239563-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cfaa13d2-bfd1-4e28-8e68-1f19edd73706 req-3b2b31b4-10c7-4276-8756-4f85be0a4308 service nova] Releasing lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:51:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Successfully created port: 7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:51:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:39 user nova-compute[73068]: INFO nova.compute.manager [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Detaching volume 5f0d3b95-6a20-4c59-9fe6-5bd535726501
Aug 26 11:51:39 user nova-compute[73068]: INFO nova.virt.block_device [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Attempting to driver detach volume 5f0d3b95-6a20-4c59-9fe6-5bd535726501 from mountpoint /dev/vdb
Aug 26 11:51:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Attempting to detach device vdb from instance 4695a204-a297-4971-bb38-2229dbba7a06 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:51:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:51:39 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:51:39 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:51:39 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:51:39 user nova-compute[73068]:   <serial>5f0d3b95-6a20-4c59-9fe6-5bd535726501</serial>
Aug 26 11:51:39 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 11:51:39 user nova-compute[73068]: </disk>
Aug 26 11:51:39 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:51:39 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully detached device vdb from instance 4695a204-a297-4971-bb38-2229dbba7a06 from the persistent domain config.
Aug 26 11:51:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4695a204-a297-4971-bb38-2229dbba7a06 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:51:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:51:39 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:51:39 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:51:39 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:51:39 user nova-compute[73068]:   <serial>5f0d3b95-6a20-4c59-9fe6-5bd535726501</serial>
Aug 26 11:51:39 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 11:51:39 user nova-compute[73068]: </disk>
Aug 26 11:51:39 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:40 user nova-compute[73068]: INFO nova.compute.manager [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Rebooting instance
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquired lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050700.2136066, 4695a204-a297-4971-bb38-2229dbba7a06 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4695a204-a297-4971-bb38-2229dbba7a06 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:51:40 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully detached device vdb from instance 4695a204-a297-4971-bb38-2229dbba7a06 from the live domain config.
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTQPZfIr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:51:40 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09cd0ca-2ca8-4895-ab35-5d3411c06839]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aef037a-438b-4802-8024-a877fd242d54]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:51:40 user nova-compute[73068]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:40 user nova-compute[73068]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:40 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 (non-flash)
Aug 26 11:51:40 user nova-compute[73068]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:40 user nova-compute[73068]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:40 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9036a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8ea48a-46f0-4079-88a9-0baef5bfa44c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ecc9eb-4e1e-44d3-9675-7a0b48132a66]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c3c4ef-47ea-4f6c-bfc7-1b5503acf7b4]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e396616-a32b-4a7b-876c-629042a10f97]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1226e69e-1392-4af9-a4ed-fbba0e222b50]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62f1d40-eddf-493c-9789-900858162402]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260]
Aug 26 11:51:40 user nova-compute[73068]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501, portal: 172.16.0.220,3260] successful.
Aug 26 11:51:40 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f0d3b95-6a20-4c59-9fe6-5bd535726501 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cd2440-18d7-402d-a5d2-c32cc5152eaa]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== disconnect_volume: return (300ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updating instance_info_cache with network_info: [{"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Releasing lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Successfully updated port: 7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquired lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-3393ead6-e9e7-4cb7-9fc8-e4cb5ef93339 req-930b2adf-7e57-43fb-a696-24c8d7884712 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-changed-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-3393ead6-e9e7-4cb7-9fc8-e4cb5ef93339 req-930b2adf-7e57-43fb-a696-24c8d7884712 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Refreshing instance network info cache due to event network-changed-7c7fbd06-9335-4a5c-b050-689da6247962. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3393ead6-e9e7-4cb7-9fc8-e4cb5ef93339 req-930b2adf-7e57-43fb-a696-24c8d7884712 service nova] Acquiring lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-a9cb6648-29ba-4dd0-b411-f4547a596da0 req-1a48e19a-f439-4707-b10b-5bc17caa94d7 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-vif-unplugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a9cb6648-29ba-4dd0-b411-f4547a596da0 req-1a48e19a-f439-4707-b10b-5bc17caa94d7 service nova] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a9cb6648-29ba-4dd0-b411-f4547a596da0 req-1a48e19a-f439-4707-b10b-5bc17caa94d7 service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a9cb6648-29ba-4dd0-b411-f4547a596da0 req-1a48e19a-f439-4707-b10b-5bc17caa94d7 service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-a9cb6648-29ba-4dd0-b411-f4547a596da0 req-1a48e19a-f439-4707-b10b-5bc17caa94d7 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] No waiting events found dispatching network-vif-unplugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:51:41 user nova-compute[73068]: WARNING nova.compute.manager [req-a9cb6648-29ba-4dd0-b411-f4547a596da0 req-1a48e19a-f439-4707-b10b-5bc17caa94d7 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received unexpected event network-vif-unplugged-790e07ee-1860-4415-a671-7969034dc83f for instance with vm_state active and task_state reboot_started_hard.
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.network.neutron [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Updating instance_info_cache with network_info: [{"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Releasing lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Instance network_info: |[{"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3393ead6-e9e7-4cb7-9fc8-e4cb5ef93339 req-930b2adf-7e57-43fb-a696-24c8d7884712 service nova] Acquired lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-3393ead6-e9e7-4cb7-9fc8-e4cb5ef93339 req-930b2adf-7e57-43fb-a696-24c8d7884712 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Refreshing network info cache for port 7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:51:41 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Instance destroyed successfully.
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.objects.instance [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'resources' on Instance uuid 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-122193301',display_name='tempest-TestMinimumBasicScenario-server-122193301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-122193301',id=32,image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc3zI5JUNvcSNmaG4QDVrBpzH2Bek6CKPWrLNw2QmEbE/LUlIGWW3yWWt7CUaBJssBVJFA23Lr08zPblAFeKLZhu9iz7PyHlE9IkHNFWPPicNXELowoEsGLXPtidOkX8w==',key_name='tempest-TestMinimumBasicScenario-576065042',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:49:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcb9735c89849778fdb45c0ac6928a8',ramdisk_id='',reservation_id='r-q8q8q636',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-143892643',owner_user_name='tempest-TestMinimumBasicScenario-143892643-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:51:41Z,user_data=None,user_id='ed16b9cc5d7545dc842e87d9cc7b234e',uuid=143fe7ef-b157-4cc0-84bf-f19ede2190ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converting VIF {"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_vif [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap790e07ee-18, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:51:41 user nova-compute[73068]: INFO os_vif [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18')
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiTRztNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:51:41 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-3393ead6-e9e7-4cb7-9fc8-e4cb5ef93339 req-930b2adf-7e57-43fb-a696-24c8d7884712 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Updated VIF entry in instance network info cache for port 7c7fbd06-9335-4a5c-b050-689da6247962. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-3393ead6-e9e7-4cb7-9fc8-e4cb5ef93339 req-930b2adf-7e57-43fb-a696-24c8d7884712 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Updating instance_info_cache with network_info: [{"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d5571c-16e9-4016-8123-064a1a8e6bb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3393ead6-e9e7-4cb7-9fc8-e4cb5ef93339 req-930b2adf-7e57-43fb-a696-24c8d7884712 service nova] Releasing lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9598c35-b207-4d5d-b209-82fc5c24384d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:41 user nova-compute[73068]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:41 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:41 user nova-compute[73068]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:41 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd905be950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d'): ({'sdd'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Removing single pathed devices sdd {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8773bfa3-8937-4fa7-ab5c-a4ec0b31449a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36d4af0-2f04-4324-89ff-2534178fa588]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Flushing IO for device /dev/sdd {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0527be8e-362b-4313-89d1-c7fa25b42a30]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7718fb-cacf-41b8-b007-25c63c752da5]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:51:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b73de1-db6d-456f-9983-467386d7572c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[11630db0-0763-4a2d-b4d9-0cae2a02ec5d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260]
Aug 26 11:51:42 user nova-compute[73068]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260] successful.
Aug 26 11:51:42 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a800da-8945-4998-a458-e570897cec5e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] <== disconnect_volume: return (288ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Start _get_guest_xml network_info=[{"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=32f3a7e6-1601-4431-83a7-3ec08c911826,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '32f3a7e6-1601-4431-83a7-3ec08c911826'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '8e3a2229-ea19-4bf8-bdd4-398ff42c94f3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiTRztNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '143fe7ef-b157-4cc0-84bf-f19ede2190ab', 'attached_at': '', 'detached_at': '', 'volume_id': '1cadcb13-566d-4205-9b20-d62a984f523d', 'serial': '1cadcb13-566d-4205-9b20-d62a984f523d'}, 'device_type': 'disk', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:51:42 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:51:42 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=32f3a7e6-1601-4431-83a7-3ec08c911826,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.objects.instance [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'vcpu_model' on Instance uuid 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.objects.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Object Instance<143fe7ef-b157-4cc0-84bf-f19ede2190ab> lazy-loaded attributes: resources,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiTRztNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:51:42 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:51:42 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:51:42 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6e4a37-d6a5-4ffc-a9c4-ef03072c7f40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:51:42 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdbe1d3-0a01-4c4f-8e4f-abeab3353f80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d] added
Aug 26 11:51:42 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4b70bf-a7a0-4e7b-9ab7-4ffa154bbc86]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b7fdb3-bae1-40ef-b957-e7565e7c03e1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wiTRztNh {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wiTRztNh" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbff6fc0-4ed7-4767-bf06-e887ef2139a0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wiTRztNh'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1b2fc2-c33e-414c-b302-a1d6c6eaecbe]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7025d9a-9996-4735-81ec-af8d3e399da7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:42 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:42 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8a3dd0-0a89-462b-b953-6c6bb296b84d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260]
Aug 26 11:51:42 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260] successful.
Aug 26 11:51:42 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef47b65-83b2-4ca3-bf05-32d28bcbb708]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0410df5-084b-4555-8ad4-30853e436b26]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:42 user nova-compute[73068]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:42 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:42 user nova-compute[73068]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:42 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ca24d3-9860-48b7-a77d-b582a502163f]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:51:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiTRztNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.objects.instance [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'flavor' on Instance uuid 4695a204-a297-4971-bb38-2229dbba7a06 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3b090b3e-025f-4fef-99b6-dfa404b448c7 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.499s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-62dfadff-695f-41ff-8d21-3b58e47beb98 req-e116179d-55a9-45cd-96e5-e4bc900e9d13 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-62dfadff-695f-41ff-8d21-3b58e47beb98 req-e116179d-55a9-45cd-96e5-e4bc900e9d13 service nova] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-62dfadff-695f-41ff-8d21-3b58e47beb98 req-e116179d-55a9-45cd-96e5-e4bc900e9d13 service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-62dfadff-695f-41ff-8d21-3b58e47beb98 req-e116179d-55a9-45cd-96e5-e4bc900e9d13 service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-62dfadff-695f-41ff-8d21-3b58e47beb98 req-e116179d-55a9-45cd-96e5-e4bc900e9d13 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] No waiting events found dispatching network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:51:43 user nova-compute[73068]: WARNING nova.compute.manager [req-62dfadff-695f-41ff-8d21-3b58e47beb98 req-e116179d-55a9-45cd-96e5-e4bc900e9d13 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received unexpected event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f for instance with vm_state active and task_state reboot_started_hard.
Aug 26 11:51:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26165333631333564', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165333631333564', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-122193301',display_name='tempest-TestMinimumBasicScenario-server-122193301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-122193301',id=32,image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc3zI5JUNvcSNmaG4QDVrBpzH2Bek6CKPWrLNw2QmEbE/LUlIGWW3yWWt7CUaBJssBVJFA23Lr08zPblAFeKLZhu9iz7PyHlE9IkHNFWPPicNXELowoEsGLXPtidOkX8w==',key_name='tempest-TestMinimumBasicScenario-576065042',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:49:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcb9735c89849778fdb45c0ac6928a8',ramdisk_id='',reservation_id='r-q8q8q636',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-143892643',owner_user_name='tempest-TestMinimumBasicScenario-143892643-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:51:41Z,user_data=None,user_id='ed16b9cc5d7545dc842e87d9cc7b234e',uuid=143fe7ef-b157-4cc0-84bf-f19ede2190ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converting VIF {"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.objects.instance [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'pci_devices' on Instance uuid 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.objects.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Object Instance<143fe7ef-b157-4cc0-84bf-f19ede2190ab> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:51:43 user nova-compute[73068]:   <uuid>143fe7ef-b157-4cc0-84bf-f19ede2190ab</uuid>
Aug 26 11:51:43 user nova-compute[73068]:   <name>instance-00000020</name>
Aug 26 11:51:43 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:51:43 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:51:43 user nova-compute[73068]:   <metadata>
Aug 26 11:51:43 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:51:43 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:51:43 user nova-compute[73068]:       <nova:name>tempest-TestMinimumBasicScenario-server-122193301</nova:name>
Aug 26 11:51:43 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:51:42</nova:creationTime>
Aug 26 11:51:43 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:51:43 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:51:43 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:51:43 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:51:43 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:51:43 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:51:43 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:51:43 user nova-compute[73068]:       <nova:owner>
Aug 26 11:51:43 user nova-compute[73068]:         <nova:user uuid="ed16b9cc5d7545dc842e87d9cc7b234e">tempest-TestMinimumBasicScenario-143892643-project-member</nova:user>
Aug 26 11:51:43 user nova-compute[73068]:         <nova:project uuid="6dcb9735c89849778fdb45c0ac6928a8">tempest-TestMinimumBasicScenario-143892643</nova:project>
Aug 26 11:51:43 user nova-compute[73068]:       </nova:owner>
Aug 26 11:51:43 user nova-compute[73068]:       <nova:root type="image" uuid="32f3a7e6-1601-4431-83a7-3ec08c911826"/>
Aug 26 11:51:43 user nova-compute[73068]:       <nova:ports>
Aug 26 11:51:43 user nova-compute[73068]:         <nova:port uuid="790e07ee-1860-4415-a671-7969034dc83f">
Aug 26 11:51:43 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 11:51:43 user nova-compute[73068]:         </nova:port>
Aug 26 11:51:43 user nova-compute[73068]:       </nova:ports>
Aug 26 11:51:43 user nova-compute[73068]:     </nova:instance>
Aug 26 11:51:43 user nova-compute[73068]:   </metadata>
Aug 26 11:51:43 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:51:43 user nova-compute[73068]:     <system>
Aug 26 11:51:43 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:51:43 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:51:43 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:51:43 user nova-compute[73068]:       <entry name="serial">143fe7ef-b157-4cc0-84bf-f19ede2190ab</entry>
Aug 26 11:51:43 user nova-compute[73068]:       <entry name="uuid">143fe7ef-b157-4cc0-84bf-f19ede2190ab</entry>
Aug 26 11:51:43 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:51:43 user nova-compute[73068]:     </system>
Aug 26 11:51:43 user nova-compute[73068]:   </sysinfo>
Aug 26 11:51:43 user nova-compute[73068]:   <os>
Aug 26 11:51:43 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:51:43 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:51:43 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:51:43 user nova-compute[73068]:   </os>
Aug 26 11:51:43 user nova-compute[73068]:   <features>
Aug 26 11:51:43 user nova-compute[73068]:     <acpi/>
Aug 26 11:51:43 user nova-compute[73068]:     <apic/>
Aug 26 11:51:43 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:51:43 user nova-compute[73068]:   </features>
Aug 26 11:51:43 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:51:43 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:51:43 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:51:43 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:51:43 user nova-compute[73068]:   </clock>
Aug 26 11:51:43 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:51:43 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:51:43 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:51:43 user nova-compute[73068]:   </cpu>
Aug 26 11:51:43 user nova-compute[73068]:   <devices>
Aug 26 11:51:43 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:51:43 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:51:43 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk"/>
Aug 26 11:51:43 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:51:43 user nova-compute[73068]:     </disk>
Aug 26 11:51:43 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:51:43 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:51:43 user nova-compute[73068]:       <source dev="/dev/sdc"/>
Aug 26 11:51:43 user nova-compute[73068]:       <target dev="vdb" bus="virtio"/>
Aug 26 11:51:43 user nova-compute[73068]:       <serial>1cadcb13-566d-4205-9b20-d62a984f523d</serial>
Aug 26 11:51:43 user nova-compute[73068]:     </disk>
Aug 26 11:51:43 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:51:43 user nova-compute[73068]:       <mac address="fa:16:3e:ec:6f:59"/>
Aug 26 11:51:43 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:51:43 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:51:43 user nova-compute[73068]:       <target dev="tap790e07ee-18"/>
Aug 26 11:51:43 user nova-compute[73068]:     </interface>
Aug 26 11:51:43 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:51:43 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/console.log" append="off"/>
Aug 26 11:51:43 user nova-compute[73068]:     </serial>
Aug 26 11:51:43 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:51:43 user nova-compute[73068]:     <video>
Aug 26 11:51:43 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:51:43 user nova-compute[73068]:     </video>
Aug 26 11:51:43 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:51:43 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:51:43 user nova-compute[73068]:     </rng>
Aug 26 11:51:43 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:51:43 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:51:43 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:51:43 user nova-compute[73068]:     </memballoon>
Aug 26 11:51:43 user nova-compute[73068]:   </devices>
Aug 26 11:51:43 user nova-compute[73068]: </domain>
Aug 26 11:51:43 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:43 user nova-compute[73068]: INFO nova.compute.manager [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Detaching volume 3e68939a-baa1-46a3-8377-41766a576bac
Aug 26 11:51:43 user nova-compute[73068]: INFO nova.virt.block_device [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Attempting to driver detach volume 3e68939a-baa1-46a3-8377-41766a576bac from mountpoint /dev/vdb
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Attempting to detach device vdb from instance 41ef2264-c365-44ee-b4aa-8266e3537c73 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:51:43 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:51:43 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:51:43 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:51:43 user nova-compute[73068]:   <serial>3e68939a-baa1-46a3-8377-41766a576bac</serial>
Aug 26 11:51:43 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 11:51:43 user nova-compute[73068]: </disk>
Aug 26 11:51:43 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.objects.instance [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'trusted_certs' on Instance uuid 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully detached device vdb from instance 41ef2264-c365-44ee-b4aa-8266e3537c73 from the persistent domain config.
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 41ef2264-c365-44ee-b4aa-8266e3537c73 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:51:43 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:51:43 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 11:51:43 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:51:43 user nova-compute[73068]:   <serial>3e68939a-baa1-46a3-8377-41766a576bac</serial>
Aug 26 11:51:43 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 11:51:43 user nova-compute[73068]: </disk>
Aug 26 11:51:43 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG nova.objects.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Object Instance<143fe7ef-b157-4cc0-84bf-f19ede2190ab> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:51:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Cannot resize image /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.objects.instance [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'migration_context' on Instance uuid 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.objects.base [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Object Instance<143fe7ef-b157-4cc0-84bf-f19ede2190ab> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-122193301',display_name='tempest-TestMinimumBasicScenario-server-122193301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-122193301',id=32,image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc3zI5JUNvcSNmaG4QDVrBpzH2Bek6CKPWrLNw2QmEbE/LUlIGWW3yWWt7CUaBJssBVJFA23Lr08zPblAFeKLZhu9iz7PyHlE9IkHNFWPPicNXELowoEsGLXPtidOkX8w==',key_name='tempest-TestMinimumBasicScenario-576065042',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:49:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='6dcb9735c89849778fdb45c0ac6928a8',ramdisk_id='',reservation_id='r-q8q8q636',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-143892643',owner_user_name='tempest-TestMinimumBasicScenario-143892643-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:51:41Z,user_data=None,user_id='ed16b9cc5d7545dc842e87d9cc7b234e',uuid=143fe7ef-b157-4cc0-84bf-f19ede2190ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converting VIF {"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_vif [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap790e07ee-18, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap790e07ee-18, col_values=(('external_ids', {'iface-id': '790e07ee-1860-4415-a671-7969034dc83f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:6f:59', 'vm-uuid': '143fe7ef-b157-4cc0-84bf-f19ede2190ab'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.utils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050704.3885198, 41ef2264-c365-44ee-b4aa-8266e3537c73 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:44 user nova-compute[73068]: INFO os_vif [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18')
Aug 26 11:51:44 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully detached device vdb from instance 41ef2264-c365-44ee-b4aa-8266e3537c73 from the live domain config.
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8795e933-2905-45cf-aa81-c9943bbb738e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JofdKQiL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:51:44 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f4d59e-1b4b-4cdd-b1b4-c8085a30b6b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[63351ca2-4383-47ed-ab54-ab48acac8ddd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6c2d1a-223b-4ad0-80cd-a635074e34fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b14bc17-3072-4f59-8d35-9870811033a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a6a639-cef0-49b5-a301-6760712c2625]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:44 user nova-compute[73068]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:44 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac (non-flash)
Aug 26 11:51:44 user nova-compute[73068]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:44 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddbf834e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:51:44 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1030ee43-0c41-476d-a952-0346dffb8b4b]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.utils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Updating existing volume attachment record: a239d6d7-9e46-46ed-be16-8458cadd93b9 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35c7248-21dd-42fd-8777-df9001beef48]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c475f9ac-d55f-4bb9-a0c4-50e93892ea8e]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1308c0-27e7-468c-b89b-a812b74ab3b7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.244s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[81529479-0775-42a1-9a1a-66d3dd238527]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a7a6d8-9aa8-4447-b63e-bea3d0a96cab]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb9689b-8d94-4d7e-b365-3865d7c36f14]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260]
Aug 26 11:51:44 user nova-compute[73068]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac, portal: 172.16.0.220,3260] successful.
Aug 26 11:51:44 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e68939a-baa1-46a3-8377-41766a576bac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6243f4-2f1e-43b1-a607-7e0fc37769b3]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.551s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] <== disconnect_volume: return (553ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:51:44 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:51:45 user nova-compute[73068]: DEBUG nova.objects.instance [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-67901898-c287-4368-a642-6d62c7368d31 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.028s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-464a8456-c347-4b97-8870-453472cff548 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-464a8456-c347-4b97-8870-453472cff548 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-464a8456-c347-4b97-8870-453472cff548 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-464a8456-c347-4b97-8870-453472cff548 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73068) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG nova.objects.instance [None req-464a8456-c347-4b97-8870-453472cff548 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ed5e374-526f-4819-b360-87fc582c4ef3 req-d0e079c3-8d2b-491a-adc4-6afda81b1548 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ed5e374-526f-4819-b360-87fc582c4ef3 req-d0e079c3-8d2b-491a-adc4-6afda81b1548 service nova] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ed5e374-526f-4819-b360-87fc582c4ef3 req-d0e079c3-8d2b-491a-adc4-6afda81b1548 service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8ed5e374-526f-4819-b360-87fc582c4ef3 req-d0e079c3-8d2b-491a-adc4-6afda81b1548 service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-8ed5e374-526f-4819-b360-87fc582c4ef3 req-d0e079c3-8d2b-491a-adc4-6afda81b1548 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] No waiting events found dispatching network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:51:46 user nova-compute[73068]: WARNING nova.compute.manager [req-8ed5e374-526f-4819-b360-87fc582c4ef3 req-d0e079c3-8d2b-491a-adc4-6afda81b1548 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received unexpected event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f for instance with vm_state active and task_state reboot_started_hard.
Aug 26 11:51:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:47 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance destroyed successfully.
Aug 26 11:51:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-464a8456-c347-4b97-8870-453472cff548 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:51:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-464a8456-c347-4b97-8870-453472cff548 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.966s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for 143fe7ef-b157-4cc0-84bf-f19ede2190ab due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050708.2955267, 143fe7ef-b157-4cc0-84bf-f19ede2190ab => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:51:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] VM Resumed (Lifecycle Event)
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:51:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Instance rebooted successfully.
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:51:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050708.3000987, 143fe7ef-b157-4cc0-84bf-f19ede2190ab => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:51:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] VM Started (Lifecycle Event)
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] No waiting events found dispatching network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:51:48 user nova-compute[73068]: WARNING nova.compute.manager [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received unexpected event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f for instance with vm_state active and task_state reboot_started_hard.
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-unplugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-unplugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:51:48 user nova-compute[73068]: WARNING nova.compute.manager [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received unexpected event network-vif-unplugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with vm_state stopped and task_state None.
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:51:48 user nova-compute[73068]: WARNING nova.compute.manager [req-90f8fc0a-575b-4abc-91f9-4c17934cbdda req-288ad88a-9418-4ac5-9ad8-5bfb9a841f8a service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received unexpected event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with vm_state stopped and task_state None.
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2d12f105-37f8-4901-ad62-0cf5ac340004 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.275s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050693.4737015, 79b917aa-38f6-455f-bd7b-acc1330e5d66 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:51:48 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] VM Stopped (Lifecycle Event)
Aug 26 11:51:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a5b0f128-fc1a-4021-9411-38c3481432e9 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:51:49 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:51:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:52 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:51:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:55 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:51:55 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:51:56 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Creating image(s)
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Ensure instance console log exists: /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Start _get_guest_xml network_info=[{"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'a239d6d7-9e46-46ed-be16-8458cadd93b9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkRuOdBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ae831c2e-a761-4cda-95ae-9476705baa5e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f84ea73e-cf16-409a-81e3-1883a918839b', 'serial': 'f84ea73e-cf16-409a-81e3-1883a918839b'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:51:56 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:51:56 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkRuOdBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:51:56 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:51:56 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:51:56 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc57f6c-d365-405a-a3c0-0ac549e007fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:51:56 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a166fa80-7385-463c-8fcd-105c01e5436a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b] added
Aug 26 11:51:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9737fc4-131b-461b-8ffe-906af2fe7331]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7d5f56-1353-4cb6-8314-e3933e9d2c77]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkRuOdBf {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkRuOdBf" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf94361c-f641-46f4-822e-35af164a984b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkRuOdBf'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2792a8-4086-4331-b400-a2b4c20d6f7b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ce9ed0-039b-4472-b57c-d56daac616ea]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12c5476-5058-4cac-8ad7-ebcef5bd8a33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b, portal: 172.16.0.220,3260]
Aug 26 11:51:56 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b, portal: 172.16.0.220,3260] successful.
Aug 26 11:51:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a001261-84ec-4503-a78d-6364179ace23]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1156ab7d-9433-418e-8469-f223ecc8ba31]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:56 user nova-compute[73068]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:51:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:51:56 user nova-compute[73068]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:51:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:51:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe1616b-5d4c-4756-a84d-f29218ab8455]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkRuOdBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23665363865663831', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665363865663831', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1928814755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1928814755',id=34,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-xl4lhper',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:51:39Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=ae831c2e-a761-4cda-95ae-9476705baa5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:03:59,bridge_name='br-int',has_traffic_filtering=True,id=7c7fbd06-9335-4a5c-b050-689da6247962,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7fbd06-93') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG nova.objects.instance [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'pci_devices' on Instance uuid ae831c2e-a761-4cda-95ae-9476705baa5e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:51:58 user nova-compute[73068]:   <uuid>ae831c2e-a761-4cda-95ae-9476705baa5e</uuid>
Aug 26 11:51:58 user nova-compute[73068]:   <name>instance-00000022</name>
Aug 26 11:51:58 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:51:58 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:51:58 user nova-compute[73068]:   <metadata>
Aug 26 11:51:58 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:51:58 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:51:58 user nova-compute[73068]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1928814755</nova:name>
Aug 26 11:51:58 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:51:56</nova:creationTime>
Aug 26 11:51:58 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:51:58 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:51:58 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:51:58 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:51:58 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:51:58 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:51:58 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:51:58 user nova-compute[73068]:       <nova:owner>
Aug 26 11:51:58 user nova-compute[73068]:         <nova:user uuid="9cd2bf96810a4540969277c8f94d5a6d">tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member</nova:user>
Aug 26 11:51:58 user nova-compute[73068]:         <nova:project uuid="d20a527043d44250bfe0a4b9dbf3e00d">tempest-ServerBootFromVolumeStableRescueTest-343541457</nova:project>
Aug 26 11:51:58 user nova-compute[73068]:       </nova:owner>
Aug 26 11:51:58 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:51:58 user nova-compute[73068]:       <nova:ports>
Aug 26 11:51:58 user nova-compute[73068]:         <nova:port uuid="7c7fbd06-9335-4a5c-b050-689da6247962">
Aug 26 11:51:58 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 11:51:58 user nova-compute[73068]:         </nova:port>
Aug 26 11:51:58 user nova-compute[73068]:       </nova:ports>
Aug 26 11:51:58 user nova-compute[73068]:     </nova:instance>
Aug 26 11:51:58 user nova-compute[73068]:   </metadata>
Aug 26 11:51:58 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:51:58 user nova-compute[73068]:     <system>
Aug 26 11:51:58 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:51:58 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:51:58 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:51:58 user nova-compute[73068]:       <entry name="serial">ae831c2e-a761-4cda-95ae-9476705baa5e</entry>
Aug 26 11:51:58 user nova-compute[73068]:       <entry name="uuid">ae831c2e-a761-4cda-95ae-9476705baa5e</entry>
Aug 26 11:51:58 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:51:58 user nova-compute[73068]:     </system>
Aug 26 11:51:58 user nova-compute[73068]:   </sysinfo>
Aug 26 11:51:58 user nova-compute[73068]:   <os>
Aug 26 11:51:58 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:51:58 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:51:58 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:51:58 user nova-compute[73068]:   </os>
Aug 26 11:51:58 user nova-compute[73068]:   <features>
Aug 26 11:51:58 user nova-compute[73068]:     <acpi/>
Aug 26 11:51:58 user nova-compute[73068]:     <apic/>
Aug 26 11:51:58 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:51:58 user nova-compute[73068]:   </features>
Aug 26 11:51:58 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:51:58 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:51:58 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:51:58 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:51:58 user nova-compute[73068]:   </clock>
Aug 26 11:51:58 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:51:58 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:51:58 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:51:58 user nova-compute[73068]:   </cpu>
Aug 26 11:51:58 user nova-compute[73068]:   <devices>
Aug 26 11:51:58 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:51:58 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:51:58 user nova-compute[73068]:       <source dev="/dev/sdb"/>
Aug 26 11:51:58 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:51:58 user nova-compute[73068]:       <serial>f84ea73e-cf16-409a-81e3-1883a918839b</serial>
Aug 26 11:51:58 user nova-compute[73068]:     </disk>
Aug 26 11:51:58 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:51:58 user nova-compute[73068]:       <mac address="fa:16:3e:0d:03:59"/>
Aug 26 11:51:58 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:51:58 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:51:58 user nova-compute[73068]:       <target dev="tap7c7fbd06-93"/>
Aug 26 11:51:58 user nova-compute[73068]:     </interface>
Aug 26 11:51:58 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:51:58 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/console.log" append="off"/>
Aug 26 11:51:58 user nova-compute[73068]:     </serial>
Aug 26 11:51:58 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:51:58 user nova-compute[73068]:     <video>
Aug 26 11:51:58 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:51:58 user nova-compute[73068]:     </video>
Aug 26 11:51:58 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:51:58 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:51:58 user nova-compute[73068]:     </rng>
Aug 26 11:51:58 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:51:58 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:51:58 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:51:58 user nova-compute[73068]:     </memballoon>
Aug 26 11:51:58 user nova-compute[73068]:   </devices>
Aug 26 11:51:58 user nova-compute[73068]: </domain>
Aug 26 11:51:58 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1928814755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1928814755',id=34,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-xl4lhper',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:51:39Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=ae831c2e-a761-4cda-95ae-9476705baa5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:03:59,bridge_name='br-int',has_traffic_filtering=True,id=7c7fbd06-9335-4a5c-b050-689da6247962,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7fbd06-93') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG os_vif [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:03:59,bridge_name='br-int',has_traffic_filtering=True,id=7c7fbd06-9335-4a5c-b050-689da6247962,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7fbd06-93') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c7fbd06-93, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c7fbd06-93, col_values=(('external_ids', {'iface-id': '7c7fbd06-9335-4a5c-b050-689da6247962', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:03:59', 'vm-uuid': 'ae831c2e-a761-4cda-95ae-9476705baa5e'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:51:58 user nova-compute[73068]: INFO os_vif [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:03:59,bridge_name='br-int',has_traffic_filtering=True,id=7c7fbd06-9335-4a5c-b050-689da6247962,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7fbd06-93')
Aug 26 11:51:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No VIF found with MAC fa:16:3e:0d:03:59, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:51:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:51:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050721.8323298, ae831c2e-a761-4cda-95ae-9476705baa5e => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:52:02 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] VM Resumed (Lifecycle Event)
Aug 26 11:52:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050707.089271, 41ef2264-c365-44ee-b4aa-8266e3537c73 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:52:02 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] VM Stopped (Lifecycle Event)
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-e70aecf5-fa4d-4143-8c3a-a2626cd24827 req-6db9a16c-8ff0-42b4-acc8-cf5b25af216d service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e70aecf5-fa4d-4143-8c3a-a2626cd24827 req-6db9a16c-8ff0-42b4-acc8-cf5b25af216d service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e70aecf5-fa4d-4143-8c3a-a2626cd24827 req-6db9a16c-8ff0-42b4-acc8-cf5b25af216d service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e70aecf5-fa4d-4143-8c3a-a2626cd24827 req-6db9a16c-8ff0-42b4-acc8-cf5b25af216d service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-e70aecf5-fa4d-4143-8c3a-a2626cd24827 req-6db9a16c-8ff0-42b4-acc8-cf5b25af216d service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:52:02 user nova-compute[73068]: WARNING nova.compute.manager [req-e70aecf5-fa4d-4143-8c3a-a2626cd24827 req-6db9a16c-8ff0-42b4-acc8-cf5b25af216d service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received unexpected event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with vm_state building and task_state spawning.
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a2b624a3-651b-4d0f-99c8-4cc54df12458 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:52:02 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:52:02 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8099MB free_disk=25.300682067871094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:02 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Instance spawned successfully.
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:52:02 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050721.8370652, ae831c2e-a761-4cda-95ae-9476705baa5e => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:52:02 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] VM Started (Lifecycle Event)
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a2b624a3-651b-4d0f-99c8-4cc54df12458 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:52:02 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:52:02 user nova-compute[73068]: INFO nova.compute.manager [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Took 5.86 seconds to spawn the instance on the hypervisor.
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ffe8d8fe-cc8f-44ab-8b95-5db1772b724d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 41ef2264-c365-44ee-b4aa-8266e3537c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4695a204-a297-4971-bb38-2229dbba7a06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 143fe7ef-b157-4cc0-84bf-f19ede2190ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:52:02 user nova-compute[73068]: INFO nova.compute.manager [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Took 24.51 seconds to build instance.
Aug 26 11:52:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-134cfd36-5bad-46cc-8d1d-6a6e32a779f2 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.630s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-f3e4e84f-ac4b-49dc-b8ca-13c43bd0b760 req-af9aa0a6-3ddb-4e68-907a-758ec947c750 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f3e4e84f-ac4b-49dc-b8ca-13c43bd0b760 req-af9aa0a6-3ddb-4e68-907a-758ec947c750 service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f3e4e84f-ac4b-49dc-b8ca-13c43bd0b760 req-af9aa0a6-3ddb-4e68-907a-758ec947c750 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f3e4e84f-ac4b-49dc-b8ca-13c43bd0b760 req-af9aa0a6-3ddb-4e68-907a-758ec947c750 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-f3e4e84f-ac4b-49dc-b8ca-13c43bd0b760 req-af9aa0a6-3ddb-4e68-907a-758ec947c750 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:52:02 user nova-compute[73068]: WARNING nova.compute.manager [req-f3e4e84f-ac4b-49dc-b8ca-13c43bd0b760 req-af9aa0a6-3ddb-4e68-907a-758ec947c750 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received unexpected event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with vm_state building and task_state spawning.
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:52:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:03 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:03 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:03 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:52:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:52:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:52:03 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:52:04 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Updating instance_info_cache with network_info: [{"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:52:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:52:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:52:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:30 user nova-compute[73068]: INFO nova.compute.manager [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Terminating instance
Aug 26 11:52:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-e3eab57d-41e1-45e5-8cd5-2afbf37d6852 req-9f8495ee-15b1-4cc5-ae6c-8b90795567ab service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-vif-unplugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e3eab57d-41e1-45e5-8cd5-2afbf37d6852 req-9f8495ee-15b1-4cc5-ae6c-8b90795567ab service nova] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e3eab57d-41e1-45e5-8cd5-2afbf37d6852 req-9f8495ee-15b1-4cc5-ae6c-8b90795567ab service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e3eab57d-41e1-45e5-8cd5-2afbf37d6852 req-9f8495ee-15b1-4cc5-ae6c-8b90795567ab service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-e3eab57d-41e1-45e5-8cd5-2afbf37d6852 req-9f8495ee-15b1-4cc5-ae6c-8b90795567ab service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] No waiting events found dispatching network-vif-unplugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-e3eab57d-41e1-45e5-8cd5-2afbf37d6852 req-9f8495ee-15b1-4cc5-ae6c-8b90795567ab service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-vif-unplugged-f4e85893-b8db-4042-9f14-8b4678f476ed for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Instance destroyed successfully.
Aug 26 11:52:30 user nova-compute[73068]: DEBUG nova.objects.instance [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'resources' on Instance uuid 4695a204-a297-4971-bb38-2229dbba7a06 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:46:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2027283732',display_name='tempest-ServerActionsTestOtherA-server-1929852047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2027283732',id=28,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNV2C3yebI6gKAGrK2bOsWft5dAyRJojrWxRudnSObcF4K3jO7Gc7ds5KnSPXlJaAeGzxWh/3rn3+GJ58URmNE1RSJWK/aLf+iOgDbE0l7rHOETxDZ6AnrFe8HMnIA0Blw==',key_name='tempest-keypair-540704974',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:49:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-urrjz1w0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=4695a204-a297-4971-bb38-2229dbba7a06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "f4e85893-b8db-4042-9f14-8b4678f476ed", "address": "fa:16:3e:ef:4a:ff", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4e85893-b8", "ovs_interfaceid": "f4e85893-b8db-4042-9f14-8b4678f476ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG os_vif [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4e85893-b8, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:30 user nova-compute[73068]: INFO os_vif [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:4a:ff,bridge_name='br-int',has_traffic_filtering=True,id=f4e85893-b8db-4042-9f14-8b4678f476ed,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4e85893-b8')
Aug 26 11:52:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Deleting instance files /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06_del
Aug 26 11:52:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Deletion of /opt/stack/data/nova/instances/4695a204-a297-4971-bb38-2229dbba7a06_del complete
Aug 26 11:52:30 user nova-compute[73068]: INFO nova.compute.manager [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 11:52:30 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:52:30 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:52:31 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:52:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-da0e888c-9e6b-410d-ba41-769a2c095cd2 req-2f78cc8a-f725-4038-bf2b-18c869efb4d7 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-vif-deleted-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:52:31 user nova-compute[73068]: INFO nova.compute.manager [req-da0e888c-9e6b-410d-ba41-769a2c095cd2 req-2f78cc8a-f725-4038-bf2b-18c869efb4d7 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Neutron deleted interface f4e85893-b8db-4042-9f14-8b4678f476ed; detaching it from the instance and deleting it from the info cache
Aug 26 11:52:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-da0e888c-9e6b-410d-ba41-769a2c095cd2 req-2f78cc8a-f725-4038-bf2b-18c869efb4d7 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:52:31 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Took 0.97 seconds to deallocate network for instance.
Aug 26 11:52:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-da0e888c-9e6b-410d-ba41-769a2c095cd2 req-2f78cc8a-f725-4038-bf2b-18c869efb4d7 service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Detach interface failed, port_id=f4e85893-b8db-4042-9f14-8b4678f476ed, reason: Instance 4695a204-a297-4971-bb38-2229dbba7a06 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:52:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:32 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:52:32 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:52:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:32 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Deleted allocations for instance 4695a204-a297-4971-bb38-2229dbba7a06
Aug 26 11:52:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-2962c510-9de6-4db7-a95b-d85bb98d4342 req-d5b86316-4d44-4dee-8683-ad7ccba6aefc service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:52:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2962c510-9de6-4db7-a95b-d85bb98d4342 req-d5b86316-4d44-4dee-8683-ad7ccba6aefc service nova] Acquiring lock "4695a204-a297-4971-bb38-2229dbba7a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2962c510-9de6-4db7-a95b-d85bb98d4342 req-d5b86316-4d44-4dee-8683-ad7ccba6aefc service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2962c510-9de6-4db7-a95b-d85bb98d4342 req-d5b86316-4d44-4dee-8683-ad7ccba6aefc service nova] Lock "4695a204-a297-4971-bb38-2229dbba7a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-2962c510-9de6-4db7-a95b-d85bb98d4342 req-d5b86316-4d44-4dee-8683-ad7ccba6aefc service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] No waiting events found dispatching network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:52:32 user nova-compute[73068]: WARNING nova.compute.manager [req-2962c510-9de6-4db7-a95b-d85bb98d4342 req-d5b86316-4d44-4dee-8683-ad7ccba6aefc service nova] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Received unexpected event network-vif-plugged-f4e85893-b8db-4042-9f14-8b4678f476ed for instance with vm_state deleted and task_state None.
Aug 26 11:52:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7b7b729f-edc8-49bb-ba4d-0e6590567a1f tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "4695a204-a297-4971-bb38-2229dbba7a06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.499s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:52:45 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050750.8093483, 4695a204-a297-4971-bb38-2229dbba7a06 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:52:45 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] VM Stopped (Lifecycle Event)
Aug 26 11:52:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5a740dc7-1437-4404-8772-0cae82be5c06 None None] [instance: 4695a204-a297-4971-bb38-2229dbba7a06] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:52:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:52:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:52:51 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:53 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:54 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid a11f0d98-3177-4345-8d54-b76b8a348f21 {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid ffe8d8fe-cc8f-44ab-8b95-5db1772b724d {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 2011f764-7057-43ba-ba00-834376cc968e {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid ae831c2e-a761-4cda-95ae-9476705baa5e {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "a11f0d98-3177-4345-8d54-b76b8a348f21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "2011f764-7057-43ba-ba00-834376cc968e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "2011f764-7057-43ba-ba00-834376cc968e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "2011f764-7057-43ba-ba00-834376cc968e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:57 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:57 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 11:52:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:52:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:52:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:52:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:52:58 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:52:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:52:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:52:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:52:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:01 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:53:01 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8206MB free_disk=25.322574615478516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ffe8d8fe-cc8f-44ab-8b95-5db1772b724d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 41ef2264-c365-44ee-b4aa-8266e3537c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 143fe7ef-b157-4cc0-84bf-f19ede2190ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:53:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquiring lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquiring lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:02 user nova-compute[73068]: INFO nova.compute.manager [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Terminating instance
Aug 26 11:53:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG nova.compute.manager [req-06aa4930-4a51-4eae-9c9a-f627421614ed req-4dee54b1-2fc6-40f7-aeca-0acf8115a65a service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Received event network-vif-unplugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-06aa4930-4a51-4eae-9c9a-f627421614ed req-4dee54b1-2fc6-40f7-aeca-0acf8115a65a service nova] Acquiring lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-06aa4930-4a51-4eae-9c9a-f627421614ed req-4dee54b1-2fc6-40f7-aeca-0acf8115a65a service nova] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-06aa4930-4a51-4eae-9c9a-f627421614ed req-4dee54b1-2fc6-40f7-aeca-0acf8115a65a service nova] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG nova.compute.manager [req-06aa4930-4a51-4eae-9c9a-f627421614ed req-4dee54b1-2fc6-40f7-aeca-0acf8115a65a service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] No waiting events found dispatching network-vif-unplugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG nova.compute.manager [req-06aa4930-4a51-4eae-9c9a-f627421614ed req-4dee54b1-2fc6-40f7-aeca-0acf8115a65a service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Received event network-vif-unplugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:53:03 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Instance destroyed successfully.
Aug 26 11:53:03 user nova-compute[73068]: DEBUG nova.objects.instance [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lazy-loading 'resources' on Instance uuid ffe8d8fe-cc8f-44ab-8b95-5db1772b724d {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:44:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1206337114',display_name='tempest-ServerActionsTestOtherB-server-1206337114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1206337114',id=23,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFFxO6g28QnEbPVE9eEWN0xxRXJgko1+norortx0+AlfxJbRvBixXIiMb9HAbuSn6UiypXtchzFrG536bQs1YJPVnBRpPK7Gwtx3Hj+XNlG77aJy0AGfgoQcsN3bXpOiw==',key_name='tempest-keypair-1079791633',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:44:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='153275ec93514f4bae4e4df5896c1768',ramdisk_id='',reservation_id='r-a081kf7c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1424792909',owner_user_name='tempest-ServerActionsTestOtherB-1424792909-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aebb7fd9efa24a4badc4781d49254b54',uuid=ffe8d8fe-cc8f-44ab-8b95-5db1772b724d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Converting VIF {"id": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "address": "fa:16:3e:e9:29:4c", "network": {"id": "3d6ae9c3-5642-425d-8845-0da423568a0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-215227904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "153275ec93514f4bae4e4df5896c1768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6b9bfc5-4a", "ovs_interfaceid": "a6b9bfc5-4a72-4001-83b8-a2f9d4f83415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:29:4c,bridge_name='br-int',has_traffic_filtering=True,id=a6b9bfc5-4a72-4001-83b8-a2f9d4f83415,network=Network(3d6ae9c3-5642-425d-8845-0da423568a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b9bfc5-4a') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG os_vif [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:29:4c,bridge_name='br-int',has_traffic_filtering=True,id=a6b9bfc5-4a72-4001-83b8-a2f9d4f83415,network=Network(3d6ae9c3-5642-425d-8845-0da423568a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b9bfc5-4a') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6b9bfc5-4a, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:03 user nova-compute[73068]: INFO os_vif [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:29:4c,bridge_name='br-int',has_traffic_filtering=True,id=a6b9bfc5-4a72-4001-83b8-a2f9d4f83415,network=Network(3d6ae9c3-5642-425d-8845-0da423568a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6b9bfc5-4a')
Aug 26 11:53:03 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Deleting instance files /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d_del
Aug 26 11:53:03 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Deletion of /opt/stack/data/nova/instances/ffe8d8fe-cc8f-44ab-8b95-5db1772b724d_del complete
Aug 26 11:53:03 user nova-compute[73068]: INFO nova.compute.manager [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 26 11:53:03 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:53:03 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:53:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:53:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:53:04 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:53:04 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Took 1.17 seconds to deallocate network for instance.
Aug 26 11:53:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:53:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:53:04 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:53:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:04 user nova-compute[73068]: DEBUG nova.compute.manager [req-dad1258f-0e19-46c6-b282-b59c2a0b7bd5 req-f418cf38-db24-4b1f-b75a-2105cd99202e service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Received event network-vif-deleted-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:04 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:53:04 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:53:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:05 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Deleted allocations for instance ffe8d8fe-cc8f-44ab-8b95-5db1772b724d
Aug 26 11:53:05 user nova-compute[73068]: DEBUG nova.compute.manager [req-a9c8c385-02bf-45b0-9c94-befe70169bb2 req-aeac343c-5f1e-48b8-87df-20c6d6fd4c82 service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Received event network-vif-plugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a9c8c385-02bf-45b0-9c94-befe70169bb2 req-aeac343c-5f1e-48b8-87df-20c6d6fd4c82 service nova] Acquiring lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a9c8c385-02bf-45b0-9c94-befe70169bb2 req-aeac343c-5f1e-48b8-87df-20c6d6fd4c82 service nova] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a9c8c385-02bf-45b0-9c94-befe70169bb2 req-aeac343c-5f1e-48b8-87df-20c6d6fd4c82 service nova] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:05 user nova-compute[73068]: DEBUG nova.compute.manager [req-a9c8c385-02bf-45b0-9c94-befe70169bb2 req-aeac343c-5f1e-48b8-87df-20c6d6fd4c82 service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] No waiting events found dispatching network-vif-plugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:53:05 user nova-compute[73068]: WARNING nova.compute.manager [req-a9c8c385-02bf-45b0-9c94-befe70169bb2 req-aeac343c-5f1e-48b8-87df-20c6d6fd4c82 service nova] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Received unexpected event network-vif-plugged-a6b9bfc5-4a72-4001-83b8-a2f9d4f83415 for instance with vm_state deleted and task_state None.
Aug 26 11:53:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3ed31ec6-a6fb-42ee-a81d-4aeff27133c1 tempest-ServerActionsTestOtherB-1424792909 tempest-ServerActionsTestOtherB-1424792909-project-member] Lock "ffe8d8fe-cc8f-44ab-8b95-5db1772b724d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.512s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:05 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Updating instance_info_cache with network_info: [{"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:53:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:53:05 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:53:06 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:53:06 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 11:53:06 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 11:53:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:53:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:53:18 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050783.3141735, ffe8d8fe-cc8f-44ab-8b95-5db1772b724d => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:53:18 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] VM Stopped (Lifecycle Event)
Aug 26 11:53:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-098675b8-9af6-4f52-9287-b9cbb44069f0 None None] [instance: ffe8d8fe-cc8f-44ab-8b95-5db1772b724d] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:53:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:53:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:53:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:53:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:53:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:26 user nova-compute[73068]: INFO nova.compute.manager [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Unshelving
Aug 26 11:53:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:26 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'pci_requests' on Instance uuid 79b917aa-38f6-455f-bd7b-acc1330e5d66 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:26 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'numa_topology' on Instance uuid 79b917aa-38f6-455f-bd7b-acc1330e5d66 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:26 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:53:26 user nova-compute[73068]: INFO nova.compute.claims [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Claim successful on node user
Aug 26 11:53:26 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:53:26 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:53:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:26 user nova-compute[73068]: INFO nova.network.neutron [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updating port 62239563-2e85-4db8-8f92-0485fa06150a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquired lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG nova.network.neutron [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-ccc4879f-5652-4903-809f-159cbf55c115 req-99a95a6c-5008-4f91-befb-08c8bcac5ecf service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-changed-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-ccc4879f-5652-4903-809f-159cbf55c115 req-99a95a6c-5008-4f91-befb-08c8bcac5ecf service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Refreshing instance network info cache due to event network-changed-62239563-2e85-4db8-8f92-0485fa06150a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ccc4879f-5652-4903-809f-159cbf55c115 req-99a95a6c-5008-4f91-befb-08c8bcac5ecf service nova] Acquiring lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG nova.network.neutron [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updating instance_info_cache with network_info: [{"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Releasing lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:53:27 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Creating image(s)
Aug 26 11:53:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "/opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "/opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "/opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'trusted_certs' on Instance uuid 79b917aa-38f6-455f-bd7b-acc1330e5d66 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ccc4879f-5652-4903-809f-159cbf55c115 req-99a95a6c-5008-4f91-befb-08c8bcac5ecf service nova] Acquired lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG nova.network.neutron [req-ccc4879f-5652-4903-809f-159cbf55c115 req-99a95a6c-5008-4f91-befb-08c8bcac5ecf service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Refreshing network info cache for port 62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG nova.objects.base [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Object Instance<79b917aa-38f6-455f-bd7b-acc1330e5d66> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "003a7213ddc14ac5a6943424b1ba61d30a7b1df2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "003a7213ddc14ac5a6943424b1ba61d30a7b1df2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2.part --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2.part --force-share --output=json" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:29 user nova-compute[73068]: DEBUG nova.virt.images [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] 4458bdc9-9e9b-43e2-88d7-9de5acde78c9 was qcow2, converting to raw {{(pid=73068) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 11:53:29 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:53:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2.part /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2.converted {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:29 user nova-compute[73068]: INFO nova.compute.manager [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Rescuing
Aug 26 11:53:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:53:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquired lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:53:29 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:53:29 user nova-compute[73068]: DEBUG nova.network.neutron [req-ccc4879f-5652-4903-809f-159cbf55c115 req-99a95a6c-5008-4f91-befb-08c8bcac5ecf service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updated VIF entry in instance network info cache for port 62239563-2e85-4db8-8f92-0485fa06150a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:53:29 user nova-compute[73068]: DEBUG nova.network.neutron [req-ccc4879f-5652-4903-809f-159cbf55c115 req-99a95a6c-5008-4f91-befb-08c8bcac5ecf service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updating instance_info_cache with network_info: [{"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:53:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ccc4879f-5652-4903-809f-159cbf55c115 req-99a95a6c-5008-4f91-befb-08c8bcac5ecf service nova] Releasing lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2.part /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2.converted" returned: 0 in 0.839s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2.converted --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Updating instance_info_cache with network_info: [{"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Releasing lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "003a7213ddc14ac5a6943424b1ba61d30a7b1df2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.521s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2 --force-share --output=json" returned: 0 in 0.188s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "003a7213ddc14ac5a6943424b1ba61d30a7b1df2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "003a7213ddc14ac5a6943424b1ba61d30a7b1df2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2 --force-share --output=json" returned: 0 in 0.196s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2,backing_fmt=raw /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-a4594075-a2a8-417f-8d31-b51f3b5856d3 req-0bc81d90-c96a-498b-94e5-1044aaea2c5e service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-unplugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a4594075-a2a8-417f-8d31-b51f3b5856d3 req-0bc81d90-c96a-498b-94e5-1044aaea2c5e service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a4594075-a2a8-417f-8d31-b51f3b5856d3 req-0bc81d90-c96a-498b-94e5-1044aaea2c5e service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a4594075-a2a8-417f-8d31-b51f3b5856d3 req-0bc81d90-c96a-498b-94e5-1044aaea2c5e service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-a4594075-a2a8-417f-8d31-b51f3b5856d3 req-0bc81d90-c96a-498b-94e5-1044aaea2c5e service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-unplugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:53:30 user nova-compute[73068]: WARNING nova.compute.manager [req-a4594075-a2a8-417f-8d31-b51f3b5856d3 req-0bc81d90-c96a-498b-94e5-1044aaea2c5e service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received unexpected event network-vif-unplugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with vm_state active and task_state rescuing.
Aug 26 11:53:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2,backing_fmt=raw /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk 1073741824" returned: 0 in 0.069s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "003a7213ddc14ac5a6943424b1ba61d30a7b1df2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2 --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:31 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'migration_context' on Instance uuid 79b917aa-38f6-455f-bd7b-acc1330e5d66 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:31 user nova-compute[73068]: DEBUG nova.objects.base [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Object Instance<79b917aa-38f6-455f-bd7b-acc1330e5d66> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:31 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Rebasing disk image.
Aug 26 11:53:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.218s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 -F raw /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:31 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Instance destroyed successfully.
Aug 26 11:53:31 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Attempting a stable device rescue
Aug 26 11:53:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73068) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 11:53:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Instance directory exists: not creating {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 11:53:31 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Creating image(s)
Aug 26 11:53:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "/opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "/opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:31 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'trusted_certs' on Instance uuid ae831c2e-a761-4cda-95ae-9476705baa5e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "55882ca54f5e6fdc42f8b173826e3c230f987db4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "55882ca54f5e6fdc42f8b173826e3c230f987db4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4.part --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-c7d628aa-f20a-422e-b02d-6679c4e6420b req-076d2885-bf95-493f-9751-71edd0f13760 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c7d628aa-f20a-422e-b02d-6679c4e6420b req-076d2885-bf95-493f-9751-71edd0f13760 service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c7d628aa-f20a-422e-b02d-6679c4e6420b req-076d2885-bf95-493f-9751-71edd0f13760 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c7d628aa-f20a-422e-b02d-6679c4e6420b req-076d2885-bf95-493f-9751-71edd0f13760 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-c7d628aa-f20a-422e-b02d-6679c4e6420b req-076d2885-bf95-493f-9751-71edd0f13760 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:53:33 user nova-compute[73068]: WARNING nova.compute.manager [req-c7d628aa-f20a-422e-b02d-6679c4e6420b req-076d2885-bf95-493f-9751-71edd0f13760 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received unexpected event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with vm_state active and task_state rescuing.
Aug 26 11:53:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4.part --force-share --output=json" returned: 0 in 0.241s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:33 user nova-compute[73068]: DEBUG nova.virt.images [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] e09920b3-b03f-4a30-a5d2-c1a710dbf19c was qcow2, converting to raw {{(pid=73068) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 11:53:33 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:53:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4.part /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4.converted {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4.part /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4.converted" returned: 0 in 1.033s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4.converted --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4.converted --force-share --output=json" returned: 0 in 0.263s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "55882ca54f5e6fdc42f8b173826e3c230f987db4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.641s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "55882ca54f5e6fdc42f8b173826e3c230f987db4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "55882ca54f5e6fdc42f8b173826e3c230f987db4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-daa1a6b5-838d-4ada-b099-08cbdc50aea4 req-1fa8aaac-aeb6-4a64-9ad9-80b519a3623f service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-changed-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-daa1a6b5-838d-4ada-b099-08cbdc50aea4 req-1fa8aaac-aeb6-4a64-9ad9-80b519a3623f service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Refreshing instance network info cache due to event network-changed-790e07ee-1860-4415-a671-7969034dc83f. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-daa1a6b5-838d-4ada-b099-08cbdc50aea4 req-1fa8aaac-aeb6-4a64-9ad9-80b519a3623f service nova] Acquiring lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-daa1a6b5-838d-4ada-b099-08cbdc50aea4 req-1fa8aaac-aeb6-4a64-9ad9-80b519a3623f service nova] Acquired lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-daa1a6b5-838d-4ada-b099-08cbdc50aea4 req-1fa8aaac-aeb6-4a64-9ad9-80b519a3623f service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Refreshing network info cache for port 790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 -F raw /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk" returned: 0 in 4.019s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Ensure instance console log exists: /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Start _get_guest_xml network_info=[{"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b866a33431d65b6d2b8292aa6dfc286f',container_format='bare',created_at=2023-08-26T11:51:33Z,direct_url=<?>,disk_format='qcow2',id=4458bdc9-9e9b-43e2-88d7-9de5acde78c9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1850753118-shelved',owner='96de3b4133bc4201880aba9e21a28a6e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T11:51:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:53:35 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:53:35 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b866a33431d65b6d2b8292aa6dfc286f',container_format='bare',created_at=2023-08-26T11:51:33Z,direct_url=<?>,disk_format='qcow2',id=4458bdc9-9e9b-43e2-88d7-9de5acde78c9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1850753118-shelved',owner='96de3b4133bc4201880aba9e21a28a6e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T11:51:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'vcpu_model' on Instance uuid 79b917aa-38f6-455f-bd7b-acc1330e5d66 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.base [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Object Instance<79b917aa-38f6-455f-bd7b-acc1330e5d66> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1850753118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1850753118',id=33,image_ref='4458bdc9-9e9b-43e2-88d7-9de5acde78c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-987617515',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:49:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-wmhja631',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member',shelved_at='2023-08-26T11:51:36.735473',shelved_host='user',shelved_image_id='4458bdc9-9e9b-43e2-88d7-9de5acde78c9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:53:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=79b917aa-38f6-455f-bd7b-acc1330e5d66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'pci_devices' on Instance uuid 79b917aa-38f6-455f-bd7b-acc1330e5d66 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4 --force-share --output=json" returned: 0 in 0.223s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4,backing_fmt=raw /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.rescue {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.base [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Object Instance<79b917aa-38f6-455f-bd7b-acc1330e5d66> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:53:35 user nova-compute[73068]:   <uuid>79b917aa-38f6-455f-bd7b-acc1330e5d66</uuid>
Aug 26 11:53:35 user nova-compute[73068]:   <name>instance-00000021</name>
Aug 26 11:53:35 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:53:35 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:53:35 user nova-compute[73068]:   <metadata>
Aug 26 11:53:35 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:53:35 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1850753118</nova:name>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:53:35</nova:creationTime>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:53:35 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:53:35 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:owner>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:user uuid="5d8a761bf9474faba69a5ec80149f352">tempest-AttachVolumeShelveTestJSON-273124191-project-member</nova:user>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:project uuid="96de3b4133bc4201880aba9e21a28a6e">tempest-AttachVolumeShelveTestJSON-273124191</nova:project>
Aug 26 11:53:35 user nova-compute[73068]:       </nova:owner>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:root type="image" uuid="4458bdc9-9e9b-43e2-88d7-9de5acde78c9"/>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:ports>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:port uuid="62239563-2e85-4db8-8f92-0485fa06150a">
Aug 26 11:53:35 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 11:53:35 user nova-compute[73068]:         </nova:port>
Aug 26 11:53:35 user nova-compute[73068]:       </nova:ports>
Aug 26 11:53:35 user nova-compute[73068]:     </nova:instance>
Aug 26 11:53:35 user nova-compute[73068]:   </metadata>
Aug 26 11:53:35 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:53:35 user nova-compute[73068]:     <system>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="serial">79b917aa-38f6-455f-bd7b-acc1330e5d66</entry>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="uuid">79b917aa-38f6-455f-bd7b-acc1330e5d66</entry>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:53:35 user nova-compute[73068]:     </system>
Aug 26 11:53:35 user nova-compute[73068]:   </sysinfo>
Aug 26 11:53:35 user nova-compute[73068]:   <os>
Aug 26 11:53:35 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:53:35 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:53:35 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:53:35 user nova-compute[73068]:   </os>
Aug 26 11:53:35 user nova-compute[73068]:   <features>
Aug 26 11:53:35 user nova-compute[73068]:     <acpi/>
Aug 26 11:53:35 user nova-compute[73068]:     <apic/>
Aug 26 11:53:35 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:53:35 user nova-compute[73068]:   </features>
Aug 26 11:53:35 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:53:35 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:53:35 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:53:35 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:53:35 user nova-compute[73068]:   </clock>
Aug 26 11:53:35 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:53:35 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:53:35 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:53:35 user nova-compute[73068]:   </cpu>
Aug 26 11:53:35 user nova-compute[73068]:   <devices>
Aug 26 11:53:35 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:53:35 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:53:35 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk"/>
Aug 26 11:53:35 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:53:35 user nova-compute[73068]:     </disk>
Aug 26 11:53:35 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:53:35 user nova-compute[73068]:       <mac address="fa:16:3e:4e:88:53"/>
Aug 26 11:53:35 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:53:35 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:53:35 user nova-compute[73068]:       <target dev="tap62239563-2e"/>
Aug 26 11:53:35 user nova-compute[73068]:     </interface>
Aug 26 11:53:35 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:53:35 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/console.log" append="off"/>
Aug 26 11:53:35 user nova-compute[73068]:     </serial>
Aug 26 11:53:35 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:53:35 user nova-compute[73068]:     <video>
Aug 26 11:53:35 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:53:35 user nova-compute[73068]:     </video>
Aug 26 11:53:35 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:53:35 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:53:35 user nova-compute[73068]:     </rng>
Aug 26 11:53:35 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:53:35 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:53:35 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:53:35 user nova-compute[73068]:     </memballoon>
Aug 26 11:53:35 user nova-compute[73068]:   </devices>
Aug 26 11:53:35 user nova-compute[73068]: </domain>
Aug 26 11:53:35 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1850753118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1850753118',id=33,image_ref='4458bdc9-9e9b-43e2-88d7-9de5acde78c9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-987617515',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:49:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-wmhja631',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member',shelved_at='2023-08-26T11:51:36.735473',shelved_host='user',shelved_image_id='4458bdc9-9e9b-43e2-88d7-9de5acde78c9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:53:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=79b917aa-38f6-455f-bd7b-acc1330e5d66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_vif [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62239563-2e, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62239563-2e, col_values=(('external_ids', {'iface-id': '62239563-2e85-4db8-8f92-0485fa06150a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:88:53', 'vm-uuid': '79b917aa-38f6-455f-bd7b-acc1330e5d66'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4,backing_fmt=raw /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.rescue" returned: 0 in 0.083s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "55882ca54f5e6fdc42f8b173826e3c230f987db4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'migration_context' on Instance uuid ae831c2e-a761-4cda-95ae-9476705baa5e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Object Instance<ae831c2e-a761-4cda-95ae-9476705baa5e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Start _get_guest_xml network_info=[{"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "vif_mac": "fa:16:3e:0d:03:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e09920b3-b03f-4a30-a5d2-c1a710dbf19c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'a239d6d7-9e46-46ed-be16-8458cadd93b9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkRuOdBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ae831c2e-a761-4cda-95ae-9476705baa5e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f84ea73e-cf16-409a-81e3-1883a918839b', 'serial': 'f84ea73e-cf16-409a-81e3-1883a918839b'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'resources' on Instance uuid ae831c2e-a761-4cda-95ae-9476705baa5e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:35 user nova-compute[73068]: INFO os_vif [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e')
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Object Instance<ae831c2e-a761-4cda-95ae-9476705baa5e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'numa_topology' on Instance uuid ae831c2e-a761-4cda-95ae-9476705baa5e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Object Instance<ae831c2e-a761-4cda-95ae-9476705baa5e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:35 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:53:35 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae831c2e-a761-4cda-95ae-9476705baa5e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Object Instance<ae831c2e-a761-4cda-95ae-9476705baa5e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkRuOdBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:53:35 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:53:35 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:53:35 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] No VIF found with MAC fa:16:3e:4e:88:53, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adbd21a-9618-4fe2-92db-5660daa47492]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JkRuOdBf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 11:53:35 user nova-compute[73068]: node.name = iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b
Aug 26 11:53:35 user nova-compute[73068]: node.tpgt = -1
Aug 26 11:53:35 user nova-compute[73068]: node.startup = automatic
Aug 26 11:53:35 user nova-compute[73068]: node.leading_login = No
Aug 26 11:53:35 user nova-compute[73068]: iface.iscsi_ifacename = default
Aug 26 11:53:35 user nova-compute[73068]: iface.net_ifacename = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.ipaddress = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.prefix_len = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.hwaddress = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.transport_name = tcp
Aug 26 11:53:35 user nova-compute[73068]: iface.initiatorname = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.state = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.vlan_id = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.vlan_priority = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.vlan_state = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.iface_num = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.mtu = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.port = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.bootproto = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.subnet_mask = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.gateway = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.dhcp_alt_client_id = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.dhcp_dns = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.dhcp_learn_iqn = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.dhcp_vendor_id_state = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.dhcp_vendor_id = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.dhcp_slp_da = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.fragmentation = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.gratuitous_arp = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.incoming_forwarding = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.tos_state = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.tos = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.ttl = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.delayed_ack = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.tcp_nagle = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.tcp_wsf_state = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.tcp_wsf = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.tcp_timer_scale = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.tcp_timestamp = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.redirect = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.def_task_mgmt_timeout = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.header_digest = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.data_digest = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.immediate_data = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.initial_r2t = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.data_seq_inorder = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.data_pdu_inorder = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.erl = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.max_receive_data_len = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.first_burst_len = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.max_outstanding_r2t = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.max_burst_len = 0
Aug 26 11:53:35 user nova-compute[73068]: iface.chap_auth = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.bidi_chap = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.strict_login_compliance = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.discovery_auth = <empty>
Aug 26 11:53:35 user nova-compute[73068]: iface.discovery_logout = <empty>
Aug 26 11:53:35 user nova-compute[73068]: node.discovery_address = <empty>
Aug 26 11:53:35 user nova-compute[73068]: node.discovery_port = 0
Aug 26 11:53:35 user nova-compute[73068]: node.discovery_type = static
Aug 26 11:53:35 user nova-compute[73068]: node.session.initial_cmdsn = 0
Aug 26 11:53:35 user nova-compute[73068]: node.session.initial_login_retry_max = 8
Aug 26 11:53:35 user nova-compute[73068]: node.session.xmit_thread_priority = -20
Aug 26 11:53:35 user nova-compute[73068]: node.session.cmds_max = 128
Aug 26 11:53:35 user nova-compute[73068]: node.session.queue_depth = 32
Aug 26 11:53:35 user nova-compute[73068]: node.session.nr_sessions = 1
Aug 26 11:53:35 user nova-compute[73068]: node.session.auth.authmethod = CHAP
Aug 26 11:53:35 user nova-compute[73068]: node.session.auth.username = JkRuOdBf
Aug 26 11:53:35 user nova-compute[73068]: node.session.auth.password = ***
Aug 26 11:53:35 user nova-compute[73068]: node.session.auth.username_in = <empty>
Aug 26 11:53:35 user nova-compute[73068]: node.session.auth.password_in = <empty>
Aug 26 11:53:35 user nova-compute[73068]: node.session.auth.chap_algs = MD5
Aug 26 11:53:35 user nova-compute[73068]: node.session.timeo.replacement_timeout = 120
Aug 26 11:53:35 user nova-compute[73068]: node.session.err_timeo.abort_timeout = 15
Aug 26 11:53:35 user nova-compute[73068]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 11:53:35 user nova-compute[73068]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 11:53:35 user nova-compute[73068]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 11:53:35 user nova-compute[73068]: node.session.iscsi.FastAbort = Yes
Aug 26 11:53:35 user nova-compute[73068]: node.session.iscsi.InitialR2T = No
Aug 26 11:53:35 user nova-compute[73068]: node.session.iscsi.ImmediateData = Yes
Aug 26 11:53:35 user nova-compute[73068]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 11:53:35 user nova-compute[73068]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 11:53:35 user nova-compute[73068]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 11:53:35 user nova-compute[73068]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 11:53:35 user nova-compute[73068]: node.session.iscsi.MaxConnections = 1
Aug 26 11:53:35 user nova-compute[73068]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 11:53:35 user nova-compute[73068]: node.session.iscsi.ERL = 0
Aug 26 11:53:35 user nova-compute[73068]: node.session.scan = manual
Aug 26 11:53:35 user nova-compute[73068]: node.session.reopen_max = 0
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].address = 172.16.0.220
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].port = 3260
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].startup = manual
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].tcp.window_size = 524288
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].tcp.type_of_service = 0
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].timeo.logout_timeout = 15
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].timeo.login_timeout = 15
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].timeo.auth_timeout = 45
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].iscsi.DataDigest = None
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].iscsi.IFMarker = No
Aug 26 11:53:35 user nova-compute[73068]: node.conn[0].iscsi.OFMarker = No
Aug 26 11:53:35 user nova-compute[73068]: # END RECORD
Aug 26 11:53:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[94904a16-27a3-454a-badc-5e39ad2294bf]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[18da2b91-627e-4bb8-9d9e-ec9f63468548]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkRuOdBf {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JkRuOdBf" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4438d0ff-1990-49ef-88d9-584cf52d8c6c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JkRuOdBf'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49da2ac-520f-441b-ae62-232c6c153cb9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2a5390-87a5-4937-83df-bd95a563a97e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:53:35 user nova-compute[73068]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:53:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:53:35 user nova-compute[73068]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:53:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] HCTL ('33', '0', '0', 0) found on session 35 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac172912-0453-40bb-8882-40767c34b9ed]: (4, ('0 0 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching for a device in session 35 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkRuOdBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '23665363865663831', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665363865663831', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1928814755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1928814755',id=34,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:52:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-xl4lhper',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:52:02Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=ae831c2e-a761-4cda-95ae-9476705baa5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "vif_mac": "fa:16:3e:0d:03:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "vif_mac": "fa:16:3e:0d:03:59"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:03:59,bridge_name='br-int',has_traffic_filtering=True,id=7c7fbd06-9335-4a5c-b050-689da6247962,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7fbd06-93') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'pci_devices' on Instance uuid ae831c2e-a761-4cda-95ae-9476705baa5e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.objects.base [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Object Instance<ae831c2e-a761-4cda-95ae-9476705baa5e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:53:35 user nova-compute[73068]:   <uuid>ae831c2e-a761-4cda-95ae-9476705baa5e</uuid>
Aug 26 11:53:35 user nova-compute[73068]:   <name>instance-00000022</name>
Aug 26 11:53:35 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:53:35 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:53:35 user nova-compute[73068]:   <metadata>
Aug 26 11:53:35 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:53:35 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1928814755</nova:name>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:53:35</nova:creationTime>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:53:35 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:53:35 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:owner>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:user uuid="9cd2bf96810a4540969277c8f94d5a6d">tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member</nova:user>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:project uuid="d20a527043d44250bfe0a4b9dbf3e00d">tempest-ServerBootFromVolumeStableRescueTest-343541457</nova:project>
Aug 26 11:53:35 user nova-compute[73068]:       </nova:owner>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:53:35 user nova-compute[73068]:       <nova:ports>
Aug 26 11:53:35 user nova-compute[73068]:         <nova:port uuid="7c7fbd06-9335-4a5c-b050-689da6247962">
Aug 26 11:53:35 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 11:53:35 user nova-compute[73068]:         </nova:port>
Aug 26 11:53:35 user nova-compute[73068]:       </nova:ports>
Aug 26 11:53:35 user nova-compute[73068]:     </nova:instance>
Aug 26 11:53:35 user nova-compute[73068]:   </metadata>
Aug 26 11:53:35 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:53:35 user nova-compute[73068]:     <system>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="serial">ae831c2e-a761-4cda-95ae-9476705baa5e</entry>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="uuid">ae831c2e-a761-4cda-95ae-9476705baa5e</entry>
Aug 26 11:53:35 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:53:35 user nova-compute[73068]:     </system>
Aug 26 11:53:35 user nova-compute[73068]:   </sysinfo>
Aug 26 11:53:35 user nova-compute[73068]:   <os>
Aug 26 11:53:35 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:53:35 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:53:35 user nova-compute[73068]:   </os>
Aug 26 11:53:35 user nova-compute[73068]:   <features>
Aug 26 11:53:35 user nova-compute[73068]:     <acpi/>
Aug 26 11:53:35 user nova-compute[73068]:     <apic/>
Aug 26 11:53:35 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:53:35 user nova-compute[73068]:   </features>
Aug 26 11:53:35 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:53:35 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:53:35 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:53:35 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:53:35 user nova-compute[73068]:   </clock>
Aug 26 11:53:35 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:53:35 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:53:35 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:53:35 user nova-compute[73068]:   </cpu>
Aug 26 11:53:35 user nova-compute[73068]:   <devices>
Aug 26 11:53:35 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:53:35 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:53:35 user nova-compute[73068]:       <source dev="/dev/sdb"/>
Aug 26 11:53:35 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:53:35 user nova-compute[73068]:       <serial>f84ea73e-cf16-409a-81e3-1883a918839b</serial>
Aug 26 11:53:35 user nova-compute[73068]:     </disk>
Aug 26 11:53:35 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:53:35 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:53:35 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.rescue"/>
Aug 26 11:53:35 user nova-compute[73068]:       <target dev="vdb" bus="virtio"/>
Aug 26 11:53:35 user nova-compute[73068]:       <boot order="1"/>
Aug 26 11:53:35 user nova-compute[73068]:     </disk>
Aug 26 11:53:35 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:53:35 user nova-compute[73068]:       <mac address="fa:16:3e:0d:03:59"/>
Aug 26 11:53:35 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:53:35 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:53:35 user nova-compute[73068]:       <target dev="tap7c7fbd06-93"/>
Aug 26 11:53:35 user nova-compute[73068]:     </interface>
Aug 26 11:53:35 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:53:35 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/console.log" append="off"/>
Aug 26 11:53:35 user nova-compute[73068]:     </serial>
Aug 26 11:53:35 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:53:35 user nova-compute[73068]:     <video>
Aug 26 11:53:35 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:53:35 user nova-compute[73068]:     </video>
Aug 26 11:53:35 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:53:35 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:53:35 user nova-compute[73068]:     </rng>
Aug 26 11:53:35 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:53:35 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:53:35 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:53:35 user nova-compute[73068]:     </memballoon>
Aug 26 11:53:35 user nova-compute[73068]:   </devices>
Aug 26 11:53:35 user nova-compute[73068]: </domain>
Aug 26 11:53:35 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:53:35 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Instance destroyed successfully.
Aug 26 11:53:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No VIF found with MAC fa:16:3e:0d:03:59, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-daa1a6b5-838d-4ada-b099-08cbdc50aea4 req-1fa8aaac-aeb6-4a64-9ad9-80b519a3623f service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updated VIF entry in instance network info cache for port 790e07ee-1860-4415-a671-7969034dc83f. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-daa1a6b5-838d-4ada-b099-08cbdc50aea4 req-1fa8aaac-aeb6-4a64-9ad9-80b519a3623f service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updating instance_info_cache with network_info: [{"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-daa1a6b5-838d-4ada-b099-08cbdc50aea4 req-1fa8aaac-aeb6-4a64-9ad9-80b519a3623f service nova] Releasing lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:35 user nova-compute[73068]: INFO nova.compute.manager [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Detaching volume 1cadcb13-566d-4205-9b20-d62a984f523d
Aug 26 11:53:36 user nova-compute[73068]: INFO nova.virt.block_device [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Attempting to driver detach volume 1cadcb13-566d-4205-9b20-d62a984f523d from mountpoint /dev/vdb
Aug 26 11:53:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Attempting to detach device vdb from instance 143fe7ef-b157-4cc0-84bf-f19ede2190ab from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:53:36 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:53:36 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:53:36 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:53:36 user nova-compute[73068]:   <serial>1cadcb13-566d-4205-9b20-d62a984f523d</serial>
Aug 26 11:53:36 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 11:53:36 user nova-compute[73068]: </disk>
Aug 26 11:53:36 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:53:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Successfully detached device vdb from instance 143fe7ef-b157-4cc0-84bf-f19ede2190ab from the persistent domain config.
Aug 26 11:53:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 143fe7ef-b157-4cc0-84bf-f19ede2190ab from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:53:36 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:53:36 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 11:53:36 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:53:36 user nova-compute[73068]:   <serial>1cadcb13-566d-4205-9b20-d62a984f523d</serial>
Aug 26 11:53:36 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 11:53:36 user nova-compute[73068]: </disk>
Aug 26 11:53:36 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693050816.52761, 143fe7ef-b157-4cc0-84bf-f19ede2190ab => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:53:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Successfully detached device vdb from instance 143fe7ef-b157-4cc0-84bf-f19ede2190ab from the live domain config.
Aug 26 11:53:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wiTRztNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:53:36 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bd8d77-6957-4558-8cbc-14853d0a6e1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f585d4-da09-4570-b90b-66c5bc734acf]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:53:36 user nova-compute[73068]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:53:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d (non-flash)
Aug 26 11:53:36 user nova-compute[73068]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:53:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9028be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef941268-69a1-4dd5-a8a4-94e582c31c0c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a3b372-3636-482d-a2dc-9b3fa35f73d2]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e33a92-d74e-42b5-973e-da61f978d56b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f54b77e-067e-4d26-b4b1-3896862a9fa4]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aecc29-d00b-401b-af30-ed14f07280d0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b536e-c293-4563-8140-5552ceb7540b]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260]
Aug 26 11:53:36 user nova-compute[73068]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d, portal: 172.16.0.220,3260] successful.
Aug 26 11:53:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cadcb13-566d-4205-9b20-d62a984f523d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[37630da2-f723-42b3-aff2-8d04cf559896]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] <== disconnect_volume: return (261ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:53:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-5795ea27-777c-434f-a8f6-0485281e34e2 req-b6c65ae5-cb45-4ac2-9996-d1057ab9155f service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-changed-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-5795ea27-777c-434f-a8f6-0485281e34e2 req-b6c65ae5-cb45-4ac2-9996-d1057ab9155f service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Refreshing instance network info cache due to event network-changed-790e07ee-1860-4415-a671-7969034dc83f. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5795ea27-777c-434f-a8f6-0485281e34e2 req-b6c65ae5-cb45-4ac2-9996-d1057ab9155f service nova] Acquiring lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5795ea27-777c-434f-a8f6-0485281e34e2 req-b6c65ae5-cb45-4ac2-9996-d1057ab9155f service nova] Acquired lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG nova.network.neutron [req-5795ea27-777c-434f-a8f6-0485281e34e2 req-b6c65ae5-cb45-4ac2-9996-d1057ab9155f service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Refreshing network info cache for port 790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquired lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'info_cache' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG nova.objects.base [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG nova.objects.instance [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'flavor' on Instance uuid 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-17f673fd-5405-4b5c-9ba7-7cf213fe848e tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.695s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG nova.network.neutron [req-5795ea27-777c-434f-a8f6-0485281e34e2 req-b6c65ae5-cb45-4ac2-9996-d1057ab9155f service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updated VIF entry in instance network info cache for port 790e07ee-1860-4415-a671-7969034dc83f. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG nova.network.neutron [req-5795ea27-777c-434f-a8f6-0485281e34e2 req-b6c65ae5-cb45-4ac2-9996-d1057ab9155f service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updating instance_info_cache with network_info: [{"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:53:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5795ea27-777c-434f-a8f6-0485281e34e2 req-b6c65ae5-cb45-4ac2-9996-d1057ab9155f service nova] Releasing lock "refresh_cache-143fe7ef-b157-4cc0-84bf-f19ede2190ab" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-59cc4944-b35f-4a19-8b27-c71ccbe57956 req-11703315-503b-48b3-b3ff-ef1a24bb5394 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-59cc4944-b35f-4a19-8b27-c71ccbe57956 req-11703315-503b-48b3-b3ff-ef1a24bb5394 service nova] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-59cc4944-b35f-4a19-8b27-c71ccbe57956 req-11703315-503b-48b3-b3ff-ef1a24bb5394 service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-59cc4944-b35f-4a19-8b27-c71ccbe57956 req-11703315-503b-48b3-b3ff-ef1a24bb5394 service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-59cc4944-b35f-4a19-8b27-c71ccbe57956 req-11703315-503b-48b3-b3ff-ef1a24bb5394 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] No waiting events found dispatching network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:53:38 user nova-compute[73068]: WARNING nova.compute.manager [req-59cc4944-b35f-4a19-8b27-c71ccbe57956 req-11703315-503b-48b3-b3ff-ef1a24bb5394 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received unexpected event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Updating instance_info_cache with network_info: [{"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Releasing lock "refresh_cache-41ef2264-c365-44ee-b4aa-8266e3537c73" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:53:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance destroyed successfully.
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'resources' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.objects.base [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1855087128',display_name='tempest-AttachVolumeTestJSON-server-1855087128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1855087128',id=26,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8/mwF03MO1idO5kBsZjsTp9Quy8BbKtqGmyu/n7Yopwmv48cZnAqzWvqSKmsD2RP5jFSLkf0tUc/twQBPAIG/iXiF3VVNSEjceHGc2pPBap5FwQEeGG3wjFrME3DLEA==',key_name='tempest-keypair-477742915',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-mdlqzffh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=41ef2264-c365-44ee-b4aa-8266e3537c73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG os_vif [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33fb27ef-8c, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:38 user nova-compute[73068]: INFO os_vif [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c')
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Start _get_guest_xml network_info=[{"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'numa_topology' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.objects.base [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:38 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:53:38 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'vcpu_model' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.objects.base [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1855087128',display_name='tempest-AttachVolumeTestJSON-server-1855087128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1855087128',id=26,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8/mwF03MO1idO5kBsZjsTp9Quy8BbKtqGmyu/n7Yopwmv48cZnAqzWvqSKmsD2RP5jFSLkf0tUc/twQBPAIG/iXiF3VVNSEjceHGc2pPBap5FwQEeGG3wjFrME3DLEA==',key_name='tempest-keypair-477742915',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-mdlqzffh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=41ef2264-c365-44ee-b4aa-8266e3537c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'pci_devices' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.objects.base [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:53:38 user nova-compute[73068]:   <uuid>41ef2264-c365-44ee-b4aa-8266e3537c73</uuid>
Aug 26 11:53:38 user nova-compute[73068]:   <name>instance-0000001a</name>
Aug 26 11:53:38 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:53:38 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:53:38 user nova-compute[73068]:   <metadata>
Aug 26 11:53:38 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:53:38 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:53:38 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeTestJSON-server-1855087128</nova:name>
Aug 26 11:53:38 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:53:38</nova:creationTime>
Aug 26 11:53:38 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:53:38 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:53:38 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:53:38 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:53:38 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:53:38 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:53:38 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:53:38 user nova-compute[73068]:       <nova:owner>
Aug 26 11:53:38 user nova-compute[73068]:         <nova:user uuid="9f8285bc9bf348289c10e62f2179a266">tempest-AttachVolumeTestJSON-1485056682-project-member</nova:user>
Aug 26 11:53:38 user nova-compute[73068]:         <nova:project uuid="58a6670af78b4f6ea72a6d4bc4274c31">tempest-AttachVolumeTestJSON-1485056682</nova:project>
Aug 26 11:53:38 user nova-compute[73068]:       </nova:owner>
Aug 26 11:53:38 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:53:38 user nova-compute[73068]:       <nova:ports>
Aug 26 11:53:38 user nova-compute[73068]:         <nova:port uuid="33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea">
Aug 26 11:53:38 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 11:53:38 user nova-compute[73068]:         </nova:port>
Aug 26 11:53:38 user nova-compute[73068]:       </nova:ports>
Aug 26 11:53:38 user nova-compute[73068]:     </nova:instance>
Aug 26 11:53:38 user nova-compute[73068]:   </metadata>
Aug 26 11:53:38 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:53:38 user nova-compute[73068]:     <system>
Aug 26 11:53:38 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:53:38 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:53:38 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:53:38 user nova-compute[73068]:       <entry name="serial">41ef2264-c365-44ee-b4aa-8266e3537c73</entry>
Aug 26 11:53:38 user nova-compute[73068]:       <entry name="uuid">41ef2264-c365-44ee-b4aa-8266e3537c73</entry>
Aug 26 11:53:38 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:53:38 user nova-compute[73068]:     </system>
Aug 26 11:53:38 user nova-compute[73068]:   </sysinfo>
Aug 26 11:53:38 user nova-compute[73068]:   <os>
Aug 26 11:53:38 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:53:38 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:53:38 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:53:38 user nova-compute[73068]:   </os>
Aug 26 11:53:38 user nova-compute[73068]:   <features>
Aug 26 11:53:38 user nova-compute[73068]:     <acpi/>
Aug 26 11:53:38 user nova-compute[73068]:     <apic/>
Aug 26 11:53:38 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:53:38 user nova-compute[73068]:   </features>
Aug 26 11:53:38 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:53:38 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:53:38 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:53:38 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:53:38 user nova-compute[73068]:   </clock>
Aug 26 11:53:38 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:53:38 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:53:38 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:53:38 user nova-compute[73068]:   </cpu>
Aug 26 11:53:38 user nova-compute[73068]:   <devices>
Aug 26 11:53:38 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:53:38 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:53:38 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk"/>
Aug 26 11:53:38 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:53:38 user nova-compute[73068]:     </disk>
Aug 26 11:53:38 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:53:38 user nova-compute[73068]:       <mac address="fa:16:3e:eb:08:a7"/>
Aug 26 11:53:38 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:53:38 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:53:38 user nova-compute[73068]:       <target dev="tap33fb27ef-8c"/>
Aug 26 11:53:38 user nova-compute[73068]:     </interface>
Aug 26 11:53:38 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:53:38 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/console.log" append="off"/>
Aug 26 11:53:38 user nova-compute[73068]:     </serial>
Aug 26 11:53:38 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:53:38 user nova-compute[73068]:     <video>
Aug 26 11:53:38 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:53:38 user nova-compute[73068]:     </video>
Aug 26 11:53:38 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:53:38 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:53:38 user nova-compute[73068]:     </rng>
Aug 26 11:53:38 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:53:38 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:53:38 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:53:38 user nova-compute[73068]:     </memballoon>
Aug 26 11:53:38 user nova-compute[73068]:   </devices>
Aug 26 11:53:38 user nova-compute[73068]: </domain>
Aug 26 11:53:38 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'trusted_certs' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG nova.objects.base [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.235s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Cannot resize image /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'migration_context' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG nova.objects.base [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Object Instance<41ef2264-c365-44ee-b4aa-8266e3537c73> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1855087128',display_name='tempest-AttachVolumeTestJSON-server-1855087128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1855087128',id=26,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8/mwF03MO1idO5kBsZjsTp9Quy8BbKtqGmyu/n7Yopwmv48cZnAqzWvqSKmsD2RP5jFSLkf0tUc/twQBPAIG/iXiF3VVNSEjceHGc2pPBap5FwQEeGG3wjFrME3DLEA==',key_name='tempest-keypair-477742915',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-mdlqzffh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=41ef2264-c365-44ee-b4aa-8266e3537c73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG os_vif [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-33f82a94-4eae-4a3e-86f3-be7f2c76b333 req-0e5fa9a7-fc20-47bb-a641-acd4caa1c253 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-33f82a94-4eae-4a3e-86f3-be7f2c76b333 req-0e5fa9a7-fc20-47bb-a641-acd4caa1c253 service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-33f82a94-4eae-4a3e-86f3-be7f2c76b333 req-0e5fa9a7-fc20-47bb-a641-acd4caa1c253 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-33f82a94-4eae-4a3e-86f3-be7f2c76b333 req-0e5fa9a7-fc20-47bb-a641-acd4caa1c253 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-33f82a94-4eae-4a3e-86f3-be7f2c76b333 req-0e5fa9a7-fc20-47bb-a641-acd4caa1c253 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:53:39 user nova-compute[73068]: WARNING nova.compute.manager [req-33f82a94-4eae-4a3e-86f3-be7f2c76b333 req-0e5fa9a7-fc20-47bb-a641-acd4caa1c253 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received unexpected event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with vm_state active and task_state rescuing.
Aug 26 11:53:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33fb27ef-8c, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33fb27ef-8c, col_values=(('external_ids', {'iface-id': '33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:08:a7', 'vm-uuid': '41ef2264-c365-44ee-b4aa-8266e3537c73'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:53:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:39 user nova-compute[73068]: INFO os_vif [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c')
Aug 26 11:53:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-e0314cba-b596-4d9c-848b-a0beb6e54937 req-5f0af412-8a80-4745-8ee3-078defc099bb service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e0314cba-b596-4d9c-848b-a0beb6e54937 req-5f0af412-8a80-4745-8ee3-078defc099bb service nova] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e0314cba-b596-4d9c-848b-a0beb6e54937 req-5f0af412-8a80-4745-8ee3-078defc099bb service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e0314cba-b596-4d9c-848b-a0beb6e54937 req-5f0af412-8a80-4745-8ee3-078defc099bb service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-e0314cba-b596-4d9c-848b-a0beb6e54937 req-5f0af412-8a80-4745-8ee3-078defc099bb service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] No waiting events found dispatching network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:53:40 user nova-compute[73068]: WARNING nova.compute.manager [req-e0314cba-b596-4d9c-848b-a0beb6e54937 req-5f0af412-8a80-4745-8ee3-078defc099bb service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received unexpected event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 11:53:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050821.2713673, 79b917aa-38f6-455f-bd7b-acc1330e5d66 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:53:41 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] VM Resumed (Lifecycle Event)
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b20c48cc-e34e-4c1f-b665-96147db51436 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:53:41 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Instance spawned successfully.
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-f75b6cbf-7aba-4814-ba7b-09680681f356 req-bc0f59f2-b7aa-4ebd-b281-1095c4adc6d9 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f75b6cbf-7aba-4814-ba7b-09680681f356 req-bc0f59f2-b7aa-4ebd-b281-1095c4adc6d9 service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f75b6cbf-7aba-4814-ba7b-09680681f356 req-bc0f59f2-b7aa-4ebd-b281-1095c4adc6d9 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f75b6cbf-7aba-4814-ba7b-09680681f356 req-bc0f59f2-b7aa-4ebd-b281-1095c4adc6d9 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-f75b6cbf-7aba-4814-ba7b-09680681f356 req-bc0f59f2-b7aa-4ebd-b281-1095c4adc6d9 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:53:41 user nova-compute[73068]: WARNING nova.compute.manager [req-f75b6cbf-7aba-4814-ba7b-09680681f356 req-bc0f59f2-b7aa-4ebd-b281-1095c4adc6d9 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received unexpected event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with vm_state active and task_state rescuing.
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:41 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050821.2851582, 79b917aa-38f6-455f-bd7b-acc1330e5d66 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:53:41 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] VM Started (Lifecycle Event)
Aug 26 11:53:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:53:41 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for ae831c2e-a761-4cda-95ae-9476705baa5e due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050821.2853146, ae831c2e-a761-4cda-95ae-9476705baa5e => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:53:41 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] VM Resumed (Lifecycle Event)
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050821.2853897, ae831c2e-a761-4cda-95ae-9476705baa5e => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:53:41 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] VM Started (Lifecycle Event)
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:53:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:53:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d8278976-2452-45e1-8432-838cad1dc0cd tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:53:42 user nova-compute[73068]: WARNING nova.compute.manager [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received unexpected event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with vm_state stopped and task_state powering-on.
Aug 26 11:53:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:53:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:53:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:53:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:53:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:53:42 user nova-compute[73068]: WARNING nova.compute.manager [req-29a7ea43-2272-49ef-a0f4-30217df4aa28 req-f536af95-9c25-4d3c-a31f-491793eb6d91 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received unexpected event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with vm_state stopped and task_state powering-on.
Aug 26 11:53:43 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050823.4213138, 41ef2264-c365-44ee-b4aa-8266e3537c73 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:53:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] VM Resumed (Lifecycle Event)
Aug 26 11:53:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:53:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance rebooted successfully.
Aug 26 11:53:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b46a70bf-b20f-45c0-8022-d8ae8d3b22d9 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:53:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:53:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:53:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 11:53:43 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050823.4343495, 41ef2264-c365-44ee-b4aa-8266e3537c73 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:53:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] VM Started (Lifecycle Event)
Aug 26 11:53:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:53:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:53:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:49 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:52 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:53:53 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:53:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:53:56 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:53:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:53:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:53:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:54:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:03 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:54:03 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:54:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7903MB free_disk=25.209449768066406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 41ef2264-c365-44ee-b4aa-8266e3537c73 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 143fe7ef-b157-4cc0-84bf-f19ede2190ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 79b917aa-38f6-455f-bd7b-acc1330e5d66 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:54:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:54:04 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:54:04 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:54:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:54:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:54:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:54:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:54:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:54:08 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:54:08 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updating instance_info_cache with network_info: [{"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:54:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:54:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:54:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG nova.compute.manager [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:54:33 user nova-compute[73068]: INFO nova.compute.claims [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Claim successful on node user
Aug 26 11:54:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:33 user nova-compute[73068]: INFO nova.compute.manager [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Terminating instance
Aug 26 11:54:33 user nova-compute[73068]: DEBUG nova.compute.manager [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:54:33 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.network.neutron [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:54:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.policy [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dbdaab1cbb4446b8709fe4526c10317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b517fdd290f5457f99b6cc9423a809b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:54:34 user nova-compute[73068]: INFO nova.virt.block_device [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Booting with volume d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 at /dev/vda
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG os_brick.utils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-a0bff174-0114-4039-b90d-0f6d13d4d545 req-aa5769d8-17d5-4eb7-ab26-8369dec41a7d service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-vif-unplugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a0bff174-0114-4039-b90d-0f6d13d4d545 req-aa5769d8-17d5-4eb7-ab26-8369dec41a7d service nova] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a0bff174-0114-4039-b90d-0f6d13d4d545 req-aa5769d8-17d5-4eb7-ab26-8369dec41a7d service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a0bff174-0114-4039-b90d-0f6d13d4d545 req-aa5769d8-17d5-4eb7-ab26-8369dec41a7d service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-a0bff174-0114-4039-b90d-0f6d13d4d545 req-aa5769d8-17d5-4eb7-ab26-8369dec41a7d service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] No waiting events found dispatching network-vif-unplugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-a0bff174-0114-4039-b90d-0f6d13d4d545 req-aa5769d8-17d5-4eb7-ab26-8369dec41a7d service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-vif-unplugged-790e07ee-1860-4415-a671-7969034dc83f for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe3bc97-24a9-4430-ad26-50f6fb59549b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c7b73f-70d9-47ca-8721-bc30cd0b7163]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[588265ea-34fb-484e-a063-591c46430d72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f925ee-a842-4557-ae8f-8ab76d704a2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:54:34 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[80afdb4c-115c-4542-92ae-4304769d16cc]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG os_brick.utils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating existing volume attachment record: 8f22e428-19cc-4ac3-b185-d8255cc03a1a {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Instance destroyed successfully.
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.objects.instance [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'resources' on Instance uuid 143fe7ef-b157-4cc0-84bf-f19ede2190ab {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:49:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-122193301',display_name='tempest-TestMinimumBasicScenario-server-122193301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-122193301',id=32,image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc3zI5JUNvcSNmaG4QDVrBpzH2Bek6CKPWrLNw2QmEbE/LUlIGWW3yWWt7CUaBJssBVJFA23Lr08zPblAFeKLZhu9iz7PyHlE9IkHNFWPPicNXELowoEsGLXPtidOkX8w==',key_name='tempest-TestMinimumBasicScenario-576065042',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:49:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcb9735c89849778fdb45c0ac6928a8',ramdisk_id='',reservation_id='r-q8q8q636',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='32f3a7e6-1601-4431-83a7-3ec08c911826',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-143892643',owner_user_name='tempest-TestMinimumBasicScenario-143892643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:51:48Z,user_data=None,user_id='ed16b9cc5d7545dc842e87d9cc7b234e',uuid=143fe7ef-b157-4cc0-84bf-f19ede2190ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converting VIF {"id": "790e07ee-1860-4415-a671-7969034dc83f", "address": "fa:16:3e:ec:6f:59", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap790e07ee-18", "ovs_interfaceid": "790e07ee-1860-4415-a671-7969034dc83f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG os_vif [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap790e07ee-18, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:54:34 user nova-compute[73068]: INFO os_vif [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:6f:59,bridge_name='br-int',has_traffic_filtering=True,id=790e07ee-1860-4415-a671-7969034dc83f,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap790e07ee-18')
Aug 26 11:54:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Deleting instance files /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab_del
Aug 26 11:54:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Deletion of /opt/stack/data/nova/instances/143fe7ef-b157-4cc0-84bf-f19ede2190ab_del complete
Aug 26 11:54:34 user nova-compute[73068]: INFO nova.compute.manager [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 11:54:34 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:54:34 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:54:35 user nova-compute[73068]: DEBUG nova.network.neutron [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Successfully created port: 8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:54:35 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:54:35 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Took 0.68 seconds to deallocate network for instance.
Aug 26 11:54:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-4118dac8-843e-4490-8605-9c09693930a2 req-c0b853e7-69c0-4e15-ab63-2d38de75c5ef service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-vif-deleted-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:54:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:35 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:54:35 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:54:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:35 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Deleted allocations for instance 143fe7ef-b157-4cc0-84bf-f19ede2190ab
Aug 26 11:54:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-26fc57f0-6288-46d4-ac88-e1fa0944a32a tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Successfully updated port: 8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquired lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-0393f7a7-fa4e-4abb-b9d1-01d3432cc950 req-5b330b1e-e16f-4285-96d8-4cce9e0ea0bc service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-changed-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-0393f7a7-fa4e-4abb-b9d1-01d3432cc950 req-5b330b1e-e16f-4285-96d8-4cce9e0ea0bc service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Refreshing instance network info cache due to event network-changed-8d3b234c-893e-43c5-97f2-48ec745d9fb5. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0393f7a7-fa4e-4abb-b9d1-01d3432cc950 req-5b330b1e-e16f-4285-96d8-4cce9e0ea0bc service nova] Acquiring lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-0cbc6eb6-42e5-405c-ae15-4daccace5a11 req-2cfd59ab-f40f-4423-a34d-e6fe55ed4700 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0cbc6eb6-42e5-405c-ae15-4daccace5a11 req-2cfd59ab-f40f-4423-a34d-e6fe55ed4700 service nova] Acquiring lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0cbc6eb6-42e5-405c-ae15-4daccace5a11 req-2cfd59ab-f40f-4423-a34d-e6fe55ed4700 service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0cbc6eb6-42e5-405c-ae15-4daccace5a11 req-2cfd59ab-f40f-4423-a34d-e6fe55ed4700 service nova] Lock "143fe7ef-b157-4cc0-84bf-f19ede2190ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-0cbc6eb6-42e5-405c-ae15-4daccace5a11 req-2cfd59ab-f40f-4423-a34d-e6fe55ed4700 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] No waiting events found dispatching network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:54:36 user nova-compute[73068]: WARNING nova.compute.manager [req-0cbc6eb6-42e5-405c-ae15-4daccace5a11 req-2cfd59ab-f40f-4423-a34d-e6fe55ed4700 service nova] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Received unexpected event network-vif-plugged-790e07ee-1860-4415-a671-7969034dc83f for instance with vm_state deleted and task_state None.
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating instance_info_cache with network_info: [{"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Releasing lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Instance network_info: |[{"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0393f7a7-fa4e-4abb-b9d1-01d3432cc950 req-5b330b1e-e16f-4285-96d8-4cce9e0ea0bc service nova] Acquired lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.network.neutron [req-0393f7a7-fa4e-4abb-b9d1-01d3432cc950 req-5b330b1e-e16f-4285-96d8-4cce9e0ea0bc service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Refreshing network info cache for port 8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.network.neutron [req-0393f7a7-fa4e-4abb-b9d1-01d3432cc950 req-5b330b1e-e16f-4285-96d8-4cce9e0ea0bc service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updated VIF entry in instance network info cache for port 8d3b234c-893e-43c5-97f2-48ec745d9fb5. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG nova.network.neutron [req-0393f7a7-fa4e-4abb-b9d1-01d3432cc950 req-5b330b1e-e16f-4285-96d8-4cce9e0ea0bc service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating instance_info_cache with network_info: [{"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:54:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0393f7a7-fa4e-4abb-b9d1-01d3432cc950 req-5b330b1e-e16f-4285-96d8-4cce9e0ea0bc service nova] Releasing lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:54:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:54:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:54:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:54:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:54:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:54:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:54:45 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Creating image(s)
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Ensure instance console log exists: /opt/stack/data/nova/instances/1af1b911-507d-4303-bf15-b0ebc8b86665/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Start _get_guest_xml network_info=[{"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '8f22e428-19cc-4ac3-b185-d8255cc03a1a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcQIOspx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1af1b911-507d-4303-bf15-b0ebc8b86665', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1c371cd-af08-4bf5-afc2-3a3ad3e0bf46', 'serial': 'd1c371cd-af08-4bf5-afc2-3a3ad3e0bf46'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:54:45 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:54:45 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcQIOspx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:54:45 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:54:45 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:54:45 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[713f10f3-9444-4f8c-b875-84e4b4dcbc51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:54:45 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0fa357-fc16-4df6-b227-9a5c0b61487d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46] added
Aug 26 11:54:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6940cb42-497f-4a9f-be51-3517133eeefa]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fa73ac-ae40-4a83-8a87-edbe9c793b74]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcQIOspx {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcQIOspx" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d014c6-4650-4783-bfa5-b60ce562cb18]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UcQIOspx'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d94e9e1-a32e-4416-b449-56dcfcf326b5]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[10892ee9-ca2c-4824-ae4e-8366efb0738b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:54:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:54:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d9bbdd-1502-4014-97e2-392209fed30b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260]
Aug 26 11:54:45 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260] successful.
Aug 26 11:54:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3f42b4-415f-4627-b016-a6156448c94b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c43a20-b009-4f99-bee6-ce4137f9afe2]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:54:45 user nova-compute[73068]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:54:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:54:45 user nova-compute[73068]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:54:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[24348bff-f757-4a17-9da0-cd1fcb09e198]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:54:45 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:54:46 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:54:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcQIOspx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:54:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:54:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23031303938376233', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:54:46 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031303938376233', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905538226',display_name='tempest-ServerActionsTestOtherA-server-1905538226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905538226',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEidFbMuWm3Ff85RQNGqsibmn5TiGb1b1MKD1SbY+915mQ5QKEZYxmDBFmRdORKitoTVm8qIYWV2p9ti1GszyrhsioU3qq34YTLHcZIRxComRJG1yG+FKs8AGlXLqDxQ4Q==',key_name='tempest-keypair-1757051288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-f38l2awy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=1af1b911-507d-4303-bf15-b0ebc8b86665,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG nova.objects.instance [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'pci_devices' on Instance uuid 1af1b911-507d-4303-bf15-b0ebc8b86665 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:54:47 user nova-compute[73068]:   <uuid>1af1b911-507d-4303-bf15-b0ebc8b86665</uuid>
Aug 26 11:54:47 user nova-compute[73068]:   <name>instance-00000023</name>
Aug 26 11:54:47 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:54:47 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:54:47 user nova-compute[73068]:   <metadata>
Aug 26 11:54:47 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:54:47 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:54:47 user nova-compute[73068]:       <nova:name>tempest-ServerActionsTestOtherA-server-1905538226</nova:name>
Aug 26 11:54:47 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:54:45</nova:creationTime>
Aug 26 11:54:47 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:54:47 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:54:47 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:54:47 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:54:47 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:54:47 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:54:47 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:54:47 user nova-compute[73068]:       <nova:owner>
Aug 26 11:54:47 user nova-compute[73068]:         <nova:user uuid="9dbdaab1cbb4446b8709fe4526c10317">tempest-ServerActionsTestOtherA-281587706-project-member</nova:user>
Aug 26 11:54:47 user nova-compute[73068]:         <nova:project uuid="b517fdd290f5457f99b6cc9423a809b5">tempest-ServerActionsTestOtherA-281587706</nova:project>
Aug 26 11:54:47 user nova-compute[73068]:       </nova:owner>
Aug 26 11:54:47 user nova-compute[73068]:       <nova:ports>
Aug 26 11:54:47 user nova-compute[73068]:         <nova:port uuid="8d3b234c-893e-43c5-97f2-48ec745d9fb5">
Aug 26 11:54:47 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 11:54:47 user nova-compute[73068]:         </nova:port>
Aug 26 11:54:47 user nova-compute[73068]:       </nova:ports>
Aug 26 11:54:47 user nova-compute[73068]:     </nova:instance>
Aug 26 11:54:47 user nova-compute[73068]:   </metadata>
Aug 26 11:54:47 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:54:47 user nova-compute[73068]:     <system>
Aug 26 11:54:47 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:54:47 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:54:47 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:54:47 user nova-compute[73068]:       <entry name="serial">1af1b911-507d-4303-bf15-b0ebc8b86665</entry>
Aug 26 11:54:47 user nova-compute[73068]:       <entry name="uuid">1af1b911-507d-4303-bf15-b0ebc8b86665</entry>
Aug 26 11:54:47 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:54:47 user nova-compute[73068]:     </system>
Aug 26 11:54:47 user nova-compute[73068]:   </sysinfo>
Aug 26 11:54:47 user nova-compute[73068]:   <os>
Aug 26 11:54:47 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:54:47 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:54:47 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:54:47 user nova-compute[73068]:   </os>
Aug 26 11:54:47 user nova-compute[73068]:   <features>
Aug 26 11:54:47 user nova-compute[73068]:     <acpi/>
Aug 26 11:54:47 user nova-compute[73068]:     <apic/>
Aug 26 11:54:47 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:54:47 user nova-compute[73068]:   </features>
Aug 26 11:54:47 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:54:47 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:54:47 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:54:47 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:54:47 user nova-compute[73068]:   </clock>
Aug 26 11:54:47 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:54:47 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:54:47 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:54:47 user nova-compute[73068]:   </cpu>
Aug 26 11:54:47 user nova-compute[73068]:   <devices>
Aug 26 11:54:47 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:54:47 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:54:47 user nova-compute[73068]:       <source dev="/dev/sdc"/>
Aug 26 11:54:47 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:54:47 user nova-compute[73068]:       <serial>d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46</serial>
Aug 26 11:54:47 user nova-compute[73068]:     </disk>
Aug 26 11:54:47 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:54:47 user nova-compute[73068]:       <mac address="fa:16:3e:00:2b:89"/>
Aug 26 11:54:47 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:54:47 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:54:47 user nova-compute[73068]:       <target dev="tap8d3b234c-89"/>
Aug 26 11:54:47 user nova-compute[73068]:     </interface>
Aug 26 11:54:47 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:54:47 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/1af1b911-507d-4303-bf15-b0ebc8b86665/console.log" append="off"/>
Aug 26 11:54:47 user nova-compute[73068]:     </serial>
Aug 26 11:54:47 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:54:47 user nova-compute[73068]:     <video>
Aug 26 11:54:47 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:54:47 user nova-compute[73068]:     </video>
Aug 26 11:54:47 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:54:47 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:54:47 user nova-compute[73068]:     </rng>
Aug 26 11:54:47 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:54:47 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:54:47 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:54:47 user nova-compute[73068]:     </memballoon>
Aug 26 11:54:47 user nova-compute[73068]:   </devices>
Aug 26 11:54:47 user nova-compute[73068]: </domain>
Aug 26 11:54:47 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905538226',display_name='tempest-ServerActionsTestOtherA-server-1905538226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905538226',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEidFbMuWm3Ff85RQNGqsibmn5TiGb1b1MKD1SbY+915mQ5QKEZYxmDBFmRdORKitoTVm8qIYWV2p9ti1GszyrhsioU3qq34YTLHcZIRxComRJG1yG+FKs8AGlXLqDxQ4Q==',key_name='tempest-keypair-1757051288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-f38l2awy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=1af1b911-507d-4303-bf15-b0ebc8b86665,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG os_vif [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d3b234c-89, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d3b234c-89, col_values=(('external_ids', {'iface-id': '8d3b234c-893e-43c5-97f2-48ec745d9fb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:2b:89', 'vm-uuid': '1af1b911-507d-4303-bf15-b0ebc8b86665'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:47 user nova-compute[73068]: INFO os_vif [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89')
Aug 26 11:54:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:54:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No VIF found with MAC fa:16:3e:00:2b:89, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:54:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-356dee9c-1e49-4c3b-86ec-ff7e6c1d77b0 req-fe9e08be-5736-478c-906f-bd13e1781eef service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:54:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-356dee9c-1e49-4c3b-86ec-ff7e6c1d77b0 req-fe9e08be-5736-478c-906f-bd13e1781eef service nova] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-356dee9c-1e49-4c3b-86ec-ff7e6c1d77b0 req-fe9e08be-5736-478c-906f-bd13e1781eef service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-356dee9c-1e49-4c3b-86ec-ff7e6c1d77b0 req-fe9e08be-5736-478c-906f-bd13e1781eef service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-356dee9c-1e49-4c3b-86ec-ff7e6c1d77b0 req-fe9e08be-5736-478c-906f-bd13e1781eef service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] No waiting events found dispatching network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:54:48 user nova-compute[73068]: WARNING nova.compute.manager [req-356dee9c-1e49-4c3b-86ec-ff7e6c1d77b0 req-fe9e08be-5736-478c-906f-bd13e1781eef service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received unexpected event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 for instance with vm_state building and task_state spawning.
Aug 26 11:54:49 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050874.7320614, 143fe7ef-b157-4cc0-84bf-f19ede2190ab => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:54:49 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] VM Stopped (Lifecycle Event)
Aug 26 11:54:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8445b508-3ef2-4358-8090-929af0759611 None None] [instance: 143fe7ef-b157-4cc0-84bf-f19ede2190ab] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050890.498145, 1af1b911-507d-4303-bf15-b0ebc8b86665 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:54:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] VM Resumed (Lifecycle Event)
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:54:50 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Instance spawned successfully.
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:54:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050890.499806, 1af1b911-507d-4303-bf15-b0ebc8b86665 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:54:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] VM Started (Lifecycle Event)
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:54:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:54:50 user nova-compute[73068]: INFO nova.compute.manager [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Took 4.99 seconds to spawn the instance on the hypervisor.
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:54:50 user nova-compute[73068]: INFO nova.compute.manager [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Took 17.04 seconds to build instance.
Aug 26 11:54:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4c0d486d-7c91-4cc0-b22c-dc4f12d3558c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.165s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.compute.manager [req-feacdc5b-4702-4668-bb11-470094debb40 req-22f31f0a-6f71-493a-a8a4-5610a1989fe1 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-feacdc5b-4702-4668-bb11-470094debb40 req-22f31f0a-6f71-493a-a8a4-5610a1989fe1 service nova] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-feacdc5b-4702-4668-bb11-470094debb40 req-22f31f0a-6f71-493a-a8a4-5610a1989fe1 service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-feacdc5b-4702-4668-bb11-470094debb40 req-22f31f0a-6f71-493a-a8a4-5610a1989fe1 service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:54:50 user nova-compute[73068]: DEBUG nova.compute.manager [req-feacdc5b-4702-4668-bb11-470094debb40 req-22f31f0a-6f71-493a-a8a4-5610a1989fe1 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] No waiting events found dispatching network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:54:50 user nova-compute[73068]: WARNING nova.compute.manager [req-feacdc5b-4702-4668-bb11-470094debb40 req-22f31f0a-6f71-493a-a8a4-5610a1989fe1 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received unexpected event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 for instance with vm_state active and task_state None.
Aug 26 11:54:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:54 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:54:54 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:54:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:54:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:54:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:54:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:55:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:55:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:55:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:00 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:55:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:55:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:55:03 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:55:03 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7938MB free_disk=25.224620819091797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 41ef2264-c365-44ee-b4aa-8266e3537c73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 79b917aa-38f6-455f-bd7b-acc1330e5d66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 1af1b911-507d-4303-bf15-b0ebc8b86665 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:55:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:55:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:55:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:55:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:55:04 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:55:05 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updating instance_info_cache with network_info: [{"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:55:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-79b917aa-38f6-455f-bd7b-acc1330e5d66" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:55:05 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:55:05 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:55:05 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:55:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:13 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:55:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:15 user nova-compute[73068]: INFO nova.compute.manager [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Terminating instance
Aug 26 11:55:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:55:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-daa3c5fd-cd13-4415-ab9a-efb0935ca1e8 req-15e04e7a-1d9a-45b0-92d3-d4f6927448b4 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-vif-unplugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-daa3c5fd-cd13-4415-ab9a-efb0935ca1e8 req-15e04e7a-1d9a-45b0-92d3-d4f6927448b4 service nova] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-daa3c5fd-cd13-4415-ab9a-efb0935ca1e8 req-15e04e7a-1d9a-45b0-92d3-d4f6927448b4 service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-daa3c5fd-cd13-4415-ab9a-efb0935ca1e8 req-15e04e7a-1d9a-45b0-92d3-d4f6927448b4 service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-daa3c5fd-cd13-4415-ab9a-efb0935ca1e8 req-15e04e7a-1d9a-45b0-92d3-d4f6927448b4 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] No waiting events found dispatching network-vif-unplugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-daa3c5fd-cd13-4415-ab9a-efb0935ca1e8 req-15e04e7a-1d9a-45b0-92d3-d4f6927448b4 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-vif-unplugged-62239563-2e85-4db8-8f92-0485fa06150a for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:55:16 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Instance destroyed successfully.
Aug 26 11:55:16 user nova-compute[73068]: DEBUG nova.objects.instance [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lazy-loading 'resources' on Instance uuid 79b917aa-38f6-455f-bd7b-acc1330e5d66 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1850753118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1850753118',id=33,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2bTtOMnBA0E9ByfcfjqnBCDKKUPPvavcXN6V6eQxo7XHCtmTz2XISYFzCxNiagA6aW7w+2vlggBv2Ifd+P4pu7sxD6fF/JsrU1wL0AE+Be9npfc5TuNnWDeorZOapMhw==',key_name='tempest-keypair-987617515',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:53:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96de3b4133bc4201880aba9e21a28a6e',ramdisk_id='',reservation_id='r-wmhja631',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-273124191',owner_user_name='tempest-AttachVolumeShelveTestJSON-273124191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:53:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d8a761bf9474faba69a5ec80149f352',uuid=79b917aa-38f6-455f-bd7b-acc1330e5d66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converting VIF {"id": "62239563-2e85-4db8-8f92-0485fa06150a", "address": "fa:16:3e:4e:88:53", "network": {"id": "f1b468ed-aee3-41fd-ba0f-789334250e67", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1983068458-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96de3b4133bc4201880aba9e21a28a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62239563-2e", "ovs_interfaceid": "62239563-2e85-4db8-8f92-0485fa06150a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG os_vif [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62239563-2e, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:55:16 user nova-compute[73068]: INFO os_vif [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:88:53,bridge_name='br-int',has_traffic_filtering=True,id=62239563-2e85-4db8-8f92-0485fa06150a,network=Network(f1b468ed-aee3-41fd-ba0f-789334250e67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62239563-2e')
Aug 26 11:55:16 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Deleting instance files /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66_del
Aug 26 11:55:16 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Deletion of /opt/stack/data/nova/instances/79b917aa-38f6-455f-bd7b-acc1330e5d66_del complete
Aug 26 11:55:16 user nova-compute[73068]: INFO nova.compute.manager [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 11:55:16 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:55:16 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:55:17 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:55:17 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Took 0.87 seconds to deallocate network for instance.
Aug 26 11:55:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-f0f213cc-6be8-4330-8e61-1652c7237bb0 req-727fb380-8a8f-4838-8840-06e97fdae776 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-vif-deleted-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:17 user nova-compute[73068]: INFO nova.compute.manager [req-f0f213cc-6be8-4330-8e61-1652c7237bb0 req-727fb380-8a8f-4838-8840-06e97fdae776 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Neutron deleted interface 62239563-2e85-4db8-8f92-0485fa06150a; detaching it from the instance and deleting it from the info cache
Aug 26 11:55:17 user nova-compute[73068]: DEBUG nova.network.neutron [req-f0f213cc-6be8-4330-8e61-1652c7237bb0 req-727fb380-8a8f-4838-8840-06e97fdae776 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:55:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-f0f213cc-6be8-4330-8e61-1652c7237bb0 req-727fb380-8a8f-4838-8840-06e97fdae776 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Detach interface failed, port_id=62239563-2e85-4db8-8f92-0485fa06150a, reason: Instance 79b917aa-38f6-455f-bd7b-acc1330e5d66 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 11:55:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:17 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:55:17 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:55:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:17 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Deleted allocations for instance 79b917aa-38f6-455f-bd7b-acc1330e5d66
Aug 26 11:55:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-83c932c0-928a-44a1-a941-2e7afa8e26a9 tempest-AttachVolumeShelveTestJSON-273124191 tempest-AttachVolumeShelveTestJSON-273124191-project-member] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.227s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-07aa60db-966f-4385-9bd6-f5eeee4f6685 req-7d5d5f40-3634-4326-ad54-0cef590db667 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-07aa60db-966f-4385-9bd6-f5eeee4f6685 req-7d5d5f40-3634-4326-ad54-0cef590db667 service nova] Acquiring lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-07aa60db-966f-4385-9bd6-f5eeee4f6685 req-7d5d5f40-3634-4326-ad54-0cef590db667 service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-07aa60db-966f-4385-9bd6-f5eeee4f6685 req-7d5d5f40-3634-4326-ad54-0cef590db667 service nova] Lock "79b917aa-38f6-455f-bd7b-acc1330e5d66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-07aa60db-966f-4385-9bd6-f5eeee4f6685 req-7d5d5f40-3634-4326-ad54-0cef590db667 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] No waiting events found dispatching network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:55:18 user nova-compute[73068]: WARNING nova.compute.manager [req-07aa60db-966f-4385-9bd6-f5eeee4f6685 req-7d5d5f40-3634-4326-ad54-0cef590db667 service nova] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Received unexpected event network-vif-plugged-62239563-2e85-4db8-8f92-0485fa06150a for instance with vm_state deleted and task_state None.
Aug 26 11:55:20 user nova-compute[73068]: INFO nova.compute.manager [None req-1688f9c5-0d18-4446-8c28-93a62a16c49e tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Unrescuing
Aug 26 11:55:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1688f9c5-0d18-4446-8c28-93a62a16c49e tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:55:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1688f9c5-0d18-4446-8c28-93a62a16c49e tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquired lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:55:20 user nova-compute[73068]: DEBUG nova.network.neutron [None req-1688f9c5-0d18-4446-8c28-93a62a16c49e tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:55:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG nova.network.neutron [None req-1688f9c5-0d18-4446-8c28-93a62a16c49e tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Updating instance_info_cache with network_info: [{"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1688f9c5-0d18-4446-8c28-93a62a16c49e tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Releasing lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1688f9c5-0d18-4446-8c28-93a62a16c49e tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'flavor' on Instance uuid ae831c2e-a761-4cda-95ae-9476705baa5e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-6f5d3366-1595-4b14-808a-e3deb27269c6 req-a5e0fb9f-7adc-45ef-8931-7849c96ddc14 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-unplugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6f5d3366-1595-4b14-808a-e3deb27269c6 req-a5e0fb9f-7adc-45ef-8931-7849c96ddc14 service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6f5d3366-1595-4b14-808a-e3deb27269c6 req-a5e0fb9f-7adc-45ef-8931-7849c96ddc14 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6f5d3366-1595-4b14-808a-e3deb27269c6 req-a5e0fb9f-7adc-45ef-8931-7849c96ddc14 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-6f5d3366-1595-4b14-808a-e3deb27269c6 req-a5e0fb9f-7adc-45ef-8931-7849c96ddc14 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-unplugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:55:21 user nova-compute[73068]: WARNING nova.compute.manager [req-6f5d3366-1595-4b14-808a-e3deb27269c6 req-a5e0fb9f-7adc-45ef-8931-7849c96ddc14 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received unexpected event network-vif-unplugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with vm_state rescued and task_state unrescuing.
Aug 26 11:55:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:21 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Instance destroyed successfully.
Aug 26 11:55:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:55:23 user nova-compute[73068]: WARNING nova.compute.manager [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received unexpected event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with vm_state rescued and task_state unrescuing.
Aug 26 11:55:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:23 user nova-compute[73068]: DEBUG nova.compute.manager [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:55:23 user nova-compute[73068]: WARNING nova.compute.manager [req-350f3658-cbe1-42c8-91da-a4ba64f42cad req-00ca4996-3b43-4acf-b610-14628b96b608 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received unexpected event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with vm_state rescued and task_state unrescuing.
Aug 26 11:55:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for ae831c2e-a761-4cda-95ae-9476705baa5e due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 11:55:25 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050925.2617223, ae831c2e-a761-4cda-95ae-9476705baa5e => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:55:25 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] VM Resumed (Lifecycle Event)
Aug 26 11:55:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-1688f9c5-0d18-4446-8c28-93a62a16c49e tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:55:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:55:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:55:25 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 11:55:25 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050925.2667837, ae831c2e-a761-4cda-95ae-9476705baa5e => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:55:25 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] VM Started (Lifecycle Event)
Aug 26 11:55:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:55:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:55:25 user nova-compute[73068]: DEBUG nova.compute.manager [req-da518ae0-4e1b-40e2-8aec-1b70878c4b94 req-e551ddcc-044b-4049-8251-d3b3178c07f0 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-da518ae0-4e1b-40e2-8aec-1b70878c4b94 req-e551ddcc-044b-4049-8251-d3b3178c07f0 service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-da518ae0-4e1b-40e2-8aec-1b70878c4b94 req-e551ddcc-044b-4049-8251-d3b3178c07f0 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-da518ae0-4e1b-40e2-8aec-1b70878c4b94 req-e551ddcc-044b-4049-8251-d3b3178c07f0 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:25 user nova-compute[73068]: DEBUG nova.compute.manager [req-da518ae0-4e1b-40e2-8aec-1b70878c4b94 req-e551ddcc-044b-4049-8251-d3b3178c07f0 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:55:25 user nova-compute[73068]: WARNING nova.compute.manager [req-da518ae0-4e1b-40e2-8aec-1b70878c4b94 req-e551ddcc-044b-4049-8251-d3b3178c07f0 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received unexpected event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with vm_state active and task_state None.
Aug 26 11:55:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:55:28 user nova-compute[73068]: INFO nova.compute.claims [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Claim successful on node user
Aug 26 11:55:28 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:55:28 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:55:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG nova.policy [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed16b9cc5d7545dc842e87d9cc7b234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcb9735c89849778fdb45c0ac6928a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:55:28 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Creating image(s)
Aug 26 11:55:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "/opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "/opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "91f7045af6aa359917fb7ebd5e1cffb2dd91e74a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "91f7045af6aa359917fb7ebd5e1cffb2dd91e74a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a.part --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:29 user nova-compute[73068]: INFO nova.compute.manager [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Terminating instance
Aug 26 11:55:29 user nova-compute[73068]: DEBUG nova.compute.manager [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a.part --force-share --output=json" returned: 0 in 0.197s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG nova.virt.images [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] 3d553372-00b7-4300-b736-c403e601179f was qcow2, converting to raw {{(pid=73068) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a.part /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a.converted {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG nova.network.neutron [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Successfully created port: 5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-4c117647-7621-4cee-8b25-fff686441d58 req-c398652f-888b-49fb-8db6-dc1c803ad3f5 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-unplugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4c117647-7621-4cee-8b25-fff686441d58 req-c398652f-888b-49fb-8db6-dc1c803ad3f5 service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4c117647-7621-4cee-8b25-fff686441d58 req-c398652f-888b-49fb-8db6-dc1c803ad3f5 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4c117647-7621-4cee-8b25-fff686441d58 req-c398652f-888b-49fb-8db6-dc1c803ad3f5 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-4c117647-7621-4cee-8b25-fff686441d58 req-c398652f-888b-49fb-8db6-dc1c803ad3f5 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-unplugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:55:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-4c117647-7621-4cee-8b25-fff686441d58 req-c398652f-888b-49fb-8db6-dc1c803ad3f5 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-unplugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:55:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Instance destroyed successfully.
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.objects.instance [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'resources' on Instance uuid 41ef2264-c365-44ee-b4aa-8266e3537c73 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:45:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1855087128',display_name='tempest-AttachVolumeTestJSON-server-1855087128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1855087128',id=26,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIO8/mwF03MO1idO5kBsZjsTp9Quy8BbKtqGmyu/n7Yopwmv48cZnAqzWvqSKmsD2RP5jFSLkf0tUc/twQBPAIG/iXiF3VVNSEjceHGc2pPBap5FwQEeGG3wjFrME3DLEA==',key_name='tempest-keypair-477742915',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-mdlqzffh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=41ef2264-c365-44ee-b4aa-8266e3537c73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "address": "fa:16:3e:eb:08:a7", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33fb27ef-8c", "ovs_interfaceid": "33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG os_vif [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a.part /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a.converted" returned: 0 in 0.683s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a.converted --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33fb27ef-8c, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:55:30 user nova-compute[73068]: INFO os_vif [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:08:a7,bridge_name='br-int',has_traffic_filtering=True,id=33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33fb27ef-8c')
Aug 26 11:55:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Deleting instance files /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73_del
Aug 26 11:55:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Deletion of /opt/stack/data/nova/instances/41ef2264-c365-44ee-b4aa-8266e3537c73_del complete
Aug 26 11:55:30 user nova-compute[73068]: INFO nova.compute.manager [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "91f7045af6aa359917fb7ebd5e1cffb2dd91e74a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.619s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Successfully updated port: 5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquired lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-861e8087-2e88-445a-886b-e3a5815ca73f req-3f1203f9-64e0-4b89-a816-383f0fe83d8e service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-changed-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-861e8087-2e88-445a-886b-e3a5815ca73f req-3f1203f9-64e0-4b89-a816-383f0fe83d8e service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Refreshing instance network info cache due to event network-changed-5e4a0bfe-be50-46d7-a4db-56790f1cb09c. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-861e8087-2e88-445a-886b-e3a5815ca73f req-3f1203f9-64e0-4b89-a816-383f0fe83d8e service nova] Acquiring lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a --force-share --output=json" returned: 0 in 0.205s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "91f7045af6aa359917fb7ebd5e1cffb2dd91e74a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "91f7045af6aa359917fb7ebd5e1cffb2dd91e74a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a,backing_fmt=raw /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a,backing_fmt=raw /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk 1073741824" returned: 0 in 0.052s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "91f7045af6aa359917fb7ebd5e1cffb2dd91e74a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updating instance_info_cache with network_info: [{"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Releasing lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Instance network_info: |[{"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-861e8087-2e88-445a-886b-e3a5815ca73f req-3f1203f9-64e0-4b89-a816-383f0fe83d8e service nova] Acquired lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.network.neutron [req-861e8087-2e88-445a-886b-e3a5815ca73f req-3f1203f9-64e0-4b89-a816-383f0fe83d8e service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Refreshing network info cache for port 5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:55:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Cannot resize image /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Ensure instance console log exists: /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Start _get_guest_xml network_info=[{"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:55:25Z,direct_url=<?>,disk_format='qcow2',id=3d553372-00b7-4300-b736-c403e601179f,min_disk=0,min_ram=0,name='tempest-scenario-img--197497982',owner='6dcb9735c89849778fdb45c0ac6928a8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:55:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '3d553372-00b7-4300-b736-c403e601179f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:55:31 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:55:31 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:55:25Z,direct_url=<?>,disk_format='qcow2',id=3d553372-00b7-4300-b736-c403e601179f,min_disk=0,min_ram=0,name='tempest-scenario-img--197497982',owner='6dcb9735c89849778fdb45c0ac6928a8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:55:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-796775537',display_name='tempest-TestMinimumBasicScenario-server-796775537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-796775537',id=36,image_ref='3d553372-00b7-4300-b736-c403e601179f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9lmlNhLPGh/3tbaY2yFkt1XX/vcvzIk1Go5Tvx4mZgTpgDaFJoGQCAG6g1wKc9LLge/aBV2lV2akazaoLWoFn+yhmh59Zd163VEM9sy7DFnaf/SDI/J7NY82vz6q+v6w==',key_name='tempest-TestMinimumBasicScenario-673523517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcb9735c89849778fdb45c0ac6928a8',ramdisk_id='',reservation_id='r-a2499bqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3d553372-00b7-4300-b736-c403e601179f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-143892643',owner_user_name='tempest-TestMinimumBasicScenario-143892643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:55:29Z,user_data=None,user_id='ed16b9cc5d7545dc842e87d9cc7b234e',uuid=bb9c655d-7e26-45bd-9e28-a695ca25a69b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converting VIF {"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a0:52,bridge_name='br-int',has_traffic_filtering=True,id=5e4a0bfe-be50-46d7-a4db-56790f1cb09c,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4a0bfe-be') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.objects.instance [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'pci_devices' on Instance uuid bb9c655d-7e26-45bd-9e28-a695ca25a69b {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:55:31 user nova-compute[73068]:   <uuid>bb9c655d-7e26-45bd-9e28-a695ca25a69b</uuid>
Aug 26 11:55:31 user nova-compute[73068]:   <name>instance-00000024</name>
Aug 26 11:55:31 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:55:31 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:55:31 user nova-compute[73068]:   <metadata>
Aug 26 11:55:31 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:55:31 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:55:31 user nova-compute[73068]:       <nova:name>tempest-TestMinimumBasicScenario-server-796775537</nova:name>
Aug 26 11:55:31 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:55:31</nova:creationTime>
Aug 26 11:55:31 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:55:31 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:55:31 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:55:31 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:55:31 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:55:31 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:55:31 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:55:31 user nova-compute[73068]:       <nova:owner>
Aug 26 11:55:31 user nova-compute[73068]:         <nova:user uuid="ed16b9cc5d7545dc842e87d9cc7b234e">tempest-TestMinimumBasicScenario-143892643-project-member</nova:user>
Aug 26 11:55:31 user nova-compute[73068]:         <nova:project uuid="6dcb9735c89849778fdb45c0ac6928a8">tempest-TestMinimumBasicScenario-143892643</nova:project>
Aug 26 11:55:31 user nova-compute[73068]:       </nova:owner>
Aug 26 11:55:31 user nova-compute[73068]:       <nova:root type="image" uuid="3d553372-00b7-4300-b736-c403e601179f"/>
Aug 26 11:55:31 user nova-compute[73068]:       <nova:ports>
Aug 26 11:55:31 user nova-compute[73068]:         <nova:port uuid="5e4a0bfe-be50-46d7-a4db-56790f1cb09c">
Aug 26 11:55:31 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 11:55:31 user nova-compute[73068]:         </nova:port>
Aug 26 11:55:31 user nova-compute[73068]:       </nova:ports>
Aug 26 11:55:31 user nova-compute[73068]:     </nova:instance>
Aug 26 11:55:31 user nova-compute[73068]:   </metadata>
Aug 26 11:55:31 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:55:31 user nova-compute[73068]:     <system>
Aug 26 11:55:31 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:55:31 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:55:31 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:55:31 user nova-compute[73068]:       <entry name="serial">bb9c655d-7e26-45bd-9e28-a695ca25a69b</entry>
Aug 26 11:55:31 user nova-compute[73068]:       <entry name="uuid">bb9c655d-7e26-45bd-9e28-a695ca25a69b</entry>
Aug 26 11:55:31 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:55:31 user nova-compute[73068]:     </system>
Aug 26 11:55:31 user nova-compute[73068]:   </sysinfo>
Aug 26 11:55:31 user nova-compute[73068]:   <os>
Aug 26 11:55:31 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:55:31 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:55:31 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:55:31 user nova-compute[73068]:   </os>
Aug 26 11:55:31 user nova-compute[73068]:   <features>
Aug 26 11:55:31 user nova-compute[73068]:     <acpi/>
Aug 26 11:55:31 user nova-compute[73068]:     <apic/>
Aug 26 11:55:31 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:55:31 user nova-compute[73068]:   </features>
Aug 26 11:55:31 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:55:31 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:55:31 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:55:31 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:55:31 user nova-compute[73068]:   </clock>
Aug 26 11:55:31 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:55:31 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:55:31 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:55:31 user nova-compute[73068]:   </cpu>
Aug 26 11:55:31 user nova-compute[73068]:   <devices>
Aug 26 11:55:31 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:55:31 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:55:31 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk"/>
Aug 26 11:55:31 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:55:31 user nova-compute[73068]:     </disk>
Aug 26 11:55:31 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:55:31 user nova-compute[73068]:       <mac address="fa:16:3e:2f:a0:52"/>
Aug 26 11:55:31 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:55:31 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:55:31 user nova-compute[73068]:       <target dev="tap5e4a0bfe-be"/>
Aug 26 11:55:31 user nova-compute[73068]:     </interface>
Aug 26 11:55:31 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:55:31 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/console.log" append="off"/>
Aug 26 11:55:31 user nova-compute[73068]:     </serial>
Aug 26 11:55:31 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:55:31 user nova-compute[73068]:     <video>
Aug 26 11:55:31 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:55:31 user nova-compute[73068]:     </video>
Aug 26 11:55:31 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:55:31 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:55:31 user nova-compute[73068]:     </rng>
Aug 26 11:55:31 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:55:31 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:55:31 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:55:31 user nova-compute[73068]:     </memballoon>
Aug 26 11:55:31 user nova-compute[73068]:   </devices>
Aug 26 11:55:31 user nova-compute[73068]: </domain>
Aug 26 11:55:31 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-796775537',display_name='tempest-TestMinimumBasicScenario-server-796775537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-796775537',id=36,image_ref='3d553372-00b7-4300-b736-c403e601179f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9lmlNhLPGh/3tbaY2yFkt1XX/vcvzIk1Go5Tvx4mZgTpgDaFJoGQCAG6g1wKc9LLge/aBV2lV2akazaoLWoFn+yhmh59Zd163VEM9sy7DFnaf/SDI/J7NY82vz6q+v6w==',key_name='tempest-TestMinimumBasicScenario-673523517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6dcb9735c89849778fdb45c0ac6928a8',ramdisk_id='',reservation_id='r-a2499bqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3d553372-00b7-4300-b736-c403e601179f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-143892643',owner_user_name='tempest-TestMinimumBasicScenario-143892643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:55:29Z,user_data=None,user_id='ed16b9cc5d7545dc842e87d9cc7b234e',uuid=bb9c655d-7e26-45bd-9e28-a695ca25a69b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converting VIF {"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a0:52,bridge_name='br-int',has_traffic_filtering=True,id=5e4a0bfe-be50-46d7-a4db-56790f1cb09c,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4a0bfe-be') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG os_vif [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a0:52,bridge_name='br-int',has_traffic_filtering=True,id=5e4a0bfe-be50-46d7-a4db-56790f1cb09c,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4a0bfe-be') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e4a0bfe-be, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e4a0bfe-be, col_values=(('external_ids', {'iface-id': '5e4a0bfe-be50-46d7-a4db-56790f1cb09c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:a0:52', 'vm-uuid': 'bb9c655d-7e26-45bd-9e28-a695ca25a69b'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:31 user nova-compute[73068]: INFO os_vif [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:a0:52,bridge_name='br-int',has_traffic_filtering=True,id=5e4a0bfe-be50-46d7-a4db-56790f1cb09c,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4a0bfe-be')
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] No VIF found with MAC fa:16:3e:2f:a0:52, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-861e8087-2e88-445a-886b-e3a5815ca73f req-3f1203f9-64e0-4b89-a816-383f0fe83d8e service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updated VIF entry in instance network info cache for port 5e4a0bfe-be50-46d7-a4db-56790f1cb09c. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.network.neutron [req-861e8087-2e88-445a-886b-e3a5815ca73f req-3f1203f9-64e0-4b89-a816-383f0fe83d8e service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updating instance_info_cache with network_info: [{"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-861e8087-2e88-445a-886b-e3a5815ca73f req-3f1203f9-64e0-4b89-a816-383f0fe83d8e service nova] Releasing lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050916.6305254, 79b917aa-38f6-455f-bd7b-acc1330e5d66 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:55:31 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] VM Stopped (Lifecycle Event)
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8861a341-dc94-4f6e-a25c-68ba0354b3cc None None] [instance: 79b917aa-38f6-455f-bd7b-acc1330e5d66] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-525450a6-b4b7-43f4-a85a-c35f81e8167f req-3a5e651a-bc67-4112-961d-30e86f4f0678 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-525450a6-b4b7-43f4-a85a-c35f81e8167f req-3a5e651a-bc67-4112-961d-30e86f4f0678 service nova] Acquiring lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-525450a6-b4b7-43f4-a85a-c35f81e8167f req-3a5e651a-bc67-4112-961d-30e86f4f0678 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-525450a6-b4b7-43f4-a85a-c35f81e8167f req-3a5e651a-bc67-4112-961d-30e86f4f0678 service nova] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-525450a6-b4b7-43f4-a85a-c35f81e8167f req-3a5e651a-bc67-4112-961d-30e86f4f0678 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] No waiting events found dispatching network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:55:31 user nova-compute[73068]: WARNING nova.compute.manager [req-525450a6-b4b7-43f4-a85a-c35f81e8167f req-3a5e651a-bc67-4112-961d-30e86f4f0678 service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received unexpected event network-vif-plugged-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea for instance with vm_state active and task_state deleting.
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:55:31 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Took 1.58 seconds to deallocate network for instance.
Aug 26 11:55:31 user nova-compute[73068]: DEBUG nova.compute.manager [req-a931b145-d67c-4130-ba84-f7a68dac0df5 req-98f3f0e2-656c-4246-a989-f76c0b7fcdfa service nova] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Received event network-vif-deleted-33fb27ef-8c98-42dc-ac1a-ee9a18f1c4ea {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:32 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:55:32 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:55:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:32 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Deleted allocations for instance 41ef2264-c365-44ee-b4aa-8266e3537c73
Aug 26 11:55:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-431e514b-5b9f-4157-bf9c-bb167e7792d4 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "41ef2264-c365-44ee-b4aa-8266e3537c73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.022s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] No waiting events found dispatching network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:55:33 user nova-compute[73068]: WARNING nova.compute.manager [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received unexpected event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c for instance with vm_state building and task_state spawning.
Aug 26 11:55:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:33 user nova-compute[73068]: DEBUG nova.compute.manager [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] No waiting events found dispatching network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:55:33 user nova-compute[73068]: WARNING nova.compute.manager [req-d781ba4e-7764-40b9-b04f-23c944159d03 req-b999a6e9-ea71-4631-8550-8676d79c82be service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received unexpected event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c for instance with vm_state building and task_state spawning.
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050934.6413453, bb9c655d-7e26-45bd-9e28-a695ca25a69b => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:55:34 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] VM Resumed (Lifecycle Event)
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:55:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Instance spawned successfully.
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:55:34 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050934.6445816, bb9c655d-7e26-45bd-9e28-a695ca25a69b => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:55:34 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] VM Started (Lifecycle Event)
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:55:34 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:55:34 user nova-compute[73068]: INFO nova.compute.manager [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Took 6.11 seconds to spawn the instance on the hypervisor.
Aug 26 11:55:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:55:34 user nova-compute[73068]: INFO nova.compute.manager [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Took 6.86 seconds to build instance.
Aug 26 11:55:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8484cdd1-f23a-4087-84ef-0df4ab37aefb tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.949s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:55:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:55:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:55:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:55:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:55:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:45 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050930.0362706, 41ef2264-c365-44ee-b4aa-8266e3537c73 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:55:45 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] VM Stopped (Lifecycle Event)
Aug 26 11:55:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-eb8d302a-90c6-482d-b90f-da6e20dac362 None None] [instance: 41ef2264-c365-44ee-b4aa-8266e3537c73] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:55:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:55:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:55:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:55:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:55:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:55:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:55:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:55:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:56:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:56:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:56:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:56:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:56:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:56:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:02 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:56:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:56:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:56:04 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:56:04 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:56:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8156MB free_disk=25.229290008544922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 1af1b911-507d-4303-bf15-b0ebc8b86665 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance bb9c655d-7e26-45bd-9e28-a695ca25a69b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:56:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:06 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:56:06 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:56:06 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 11:56:06 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:56:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:56:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:56:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:23 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:56:23 user nova-compute[73068]: INFO nova.compute.claims [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Claim successful on node user
Aug 26 11:56:24 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG nova.network.neutron [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:56:24 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:56:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:56:24 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Creating image(s)
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "/opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "/opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "/opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG nova.policy [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f8285bc9bf348289c10e62f2179a266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a6670af78b4f6ea72a6d4bc4274c31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.214s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk 1073741824" returned: 0 in 0.065s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.223s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG nova.compute.manager [req-e860910b-d622-465a-9997-52ae97ede4f8 req-434413bb-35d0-41e6-be53-8d2cd96d3c1a service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received event network-changed-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG nova.compute.manager [req-e860910b-d622-465a-9997-52ae97ede4f8 req-434413bb-35d0-41e6-be53-8d2cd96d3c1a service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Refreshing instance network info cache due to event network-changed-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e860910b-d622-465a-9997-52ae97ede4f8 req-434413bb-35d0-41e6-be53-8d2cd96d3c1a service nova] Acquiring lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e860910b-d622-465a-9997-52ae97ede4f8 req-434413bb-35d0-41e6-be53-8d2cd96d3c1a service nova] Acquired lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG nova.network.neutron [req-e860910b-d622-465a-9997-52ae97ede4f8 req-434413bb-35d0-41e6-be53-8d2cd96d3c1a service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Refreshing network info cache for port f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Cannot resize image /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Ensure instance console log exists: /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG nova.network.neutron [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Successfully created port: 45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG nova.network.neutron [req-e860910b-d622-465a-9997-52ae97ede4f8 req-434413bb-35d0-41e6-be53-8d2cd96d3c1a service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updated VIF entry in instance network info cache for port f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG nova.network.neutron [req-e860910b-d622-465a-9997-52ae97ede4f8 req-434413bb-35d0-41e6-be53-8d2cd96d3c1a service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updating instance_info_cache with network_info: [{"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e860910b-d622-465a-9997-52ae97ede4f8 req-434413bb-35d0-41e6-be53-8d2cd96d3c1a service nova] Releasing lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:56:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-100efbec-1f59-4a26-b2e7-4d65b91d7d9f req-9880c2b6-4edb-424b-abb7-526dc9a2376a service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-changed-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-100efbec-1f59-4a26-b2e7-4d65b91d7d9f req-9880c2b6-4edb-424b-abb7-526dc9a2376a service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Refreshing instance network info cache due to event network-changed-8d3b234c-893e-43c5-97f2-48ec745d9fb5. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-100efbec-1f59-4a26-b2e7-4d65b91d7d9f req-9880c2b6-4edb-424b-abb7-526dc9a2376a service nova] Acquiring lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-100efbec-1f59-4a26-b2e7-4d65b91d7d9f req-9880c2b6-4edb-424b-abb7-526dc9a2376a service nova] Acquired lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG nova.network.neutron [req-100efbec-1f59-4a26-b2e7-4d65b91d7d9f req-9880c2b6-4edb-424b-abb7-526dc9a2376a service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Refreshing network info cache for port 8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG nova.network.neutron [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Successfully updated port: 45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "refresh_cache-d74da117-dc27-46b4-897b-763ef5137a6e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquired lock "refresh_cache-d74da117-dc27-46b4-897b-763ef5137a6e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG nova.network.neutron [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-b54b269a-022a-4a04-849b-8cc038e4b94f req-747753be-52d1-400d-ab94-34bc352c4041 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-changed-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-b54b269a-022a-4a04-849b-8cc038e4b94f req-747753be-52d1-400d-ab94-34bc352c4041 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Refreshing instance network info cache due to event network-changed-45871af6-d08f-40df-bc66-24eae82b28fc. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b54b269a-022a-4a04-849b-8cc038e4b94f req-747753be-52d1-400d-ab94-34bc352c4041 service nova] Acquiring lock "refresh_cache-d74da117-dc27-46b4-897b-763ef5137a6e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG nova.network.neutron [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:56:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Stashing vm_state: active {{(pid=73068) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:56:28 user nova-compute[73068]: INFO nova.compute.claims [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Claim successful on node user
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Updating instance_info_cache with network_info: [{"id": "45871af6-d08f-40df-bc66-24eae82b28fc", "address": "fa:16:3e:cc:9c:22", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45871af6-d0", "ovs_interfaceid": "45871af6-d08f-40df-bc66-24eae82b28fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Releasing lock "refresh_cache-d74da117-dc27-46b4-897b-763ef5137a6e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Instance network_info: |[{"id": "45871af6-d08f-40df-bc66-24eae82b28fc", "address": "fa:16:3e:cc:9c:22", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45871af6-d0", "ovs_interfaceid": "45871af6-d08f-40df-bc66-24eae82b28fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b54b269a-022a-4a04-849b-8cc038e4b94f req-747753be-52d1-400d-ab94-34bc352c4041 service nova] Acquired lock "refresh_cache-d74da117-dc27-46b4-897b-763ef5137a6e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-b54b269a-022a-4a04-849b-8cc038e4b94f req-747753be-52d1-400d-ab94-34bc352c4041 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Refreshing network info cache for port 45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Start _get_guest_xml network_info=[{"id": "45871af6-d08f-40df-bc66-24eae82b28fc", "address": "fa:16:3e:cc:9c:22", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45871af6-d0", "ovs_interfaceid": "45871af6-d08f-40df-bc66-24eae82b28fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-100efbec-1f59-4a26-b2e7-4d65b91d7d9f req-9880c2b6-4edb-424b-abb7-526dc9a2376a service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updated VIF entry in instance network info cache for port 8d3b234c-893e-43c5-97f2-48ec745d9fb5. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-100efbec-1f59-4a26-b2e7-4d65b91d7d9f req-9880c2b6-4edb-424b-abb7-526dc9a2376a service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating instance_info_cache with network_info: [{"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:56:28 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:56:28 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377830885',display_name='tempest-AttachVolumeTestJSON-server-1377830885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377830885',id=37,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsxnls5pSWEI8tJVRT6XWjo8knb/jw0ioODazScLyVBvBW14Z0xQMwhMlQpp6ZzwSSw+lOZfha1HXkAXljtsOPpxp0R24dQGyfOMkRm/2F2mL2mWcUIC5gdQeoyHYxoHg==',key_name='tempest-keypair-620631342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-03k6g0wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:56:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=d74da117-dc27-46b4-897b-763ef5137a6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45871af6-d08f-40df-bc66-24eae82b28fc", "address": "fa:16:3e:cc:9c:22", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45871af6-d0", "ovs_interfaceid": "45871af6-d08f-40df-bc66-24eae82b28fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "45871af6-d08f-40df-bc66-24eae82b28fc", "address": "fa:16:3e:cc:9c:22", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45871af6-d0", "ovs_interfaceid": "45871af6-d08f-40df-bc66-24eae82b28fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:22,bridge_name='br-int',has_traffic_filtering=True,id=45871af6-d08f-40df-bc66-24eae82b28fc,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45871af6-d0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.objects.instance [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'pci_devices' on Instance uuid d74da117-dc27-46b4-897b-763ef5137a6e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:56:28 user nova-compute[73068]: INFO nova.compute.resource_tracker [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating resource usage from migration 8db63efd-8aff-4e3f-acb1-f6db004dda57
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-100efbec-1f59-4a26-b2e7-4d65b91d7d9f req-9880c2b6-4edb-424b-abb7-526dc9a2376a service nova] Releasing lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:56:28 user nova-compute[73068]:   <uuid>d74da117-dc27-46b4-897b-763ef5137a6e</uuid>
Aug 26 11:56:28 user nova-compute[73068]:   <name>instance-00000025</name>
Aug 26 11:56:28 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:56:28 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:56:28 user nova-compute[73068]:   <metadata>
Aug 26 11:56:28 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:56:28 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:56:28 user nova-compute[73068]:       <nova:name>tempest-AttachVolumeTestJSON-server-1377830885</nova:name>
Aug 26 11:56:28 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:56:28</nova:creationTime>
Aug 26 11:56:28 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:56:28 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:56:28 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:56:28 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:56:28 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:56:28 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:56:28 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:56:28 user nova-compute[73068]:       <nova:owner>
Aug 26 11:56:28 user nova-compute[73068]:         <nova:user uuid="9f8285bc9bf348289c10e62f2179a266">tempest-AttachVolumeTestJSON-1485056682-project-member</nova:user>
Aug 26 11:56:28 user nova-compute[73068]:         <nova:project uuid="58a6670af78b4f6ea72a6d4bc4274c31">tempest-AttachVolumeTestJSON-1485056682</nova:project>
Aug 26 11:56:28 user nova-compute[73068]:       </nova:owner>
Aug 26 11:56:28 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:56:28 user nova-compute[73068]:       <nova:ports>
Aug 26 11:56:28 user nova-compute[73068]:         <nova:port uuid="45871af6-d08f-40df-bc66-24eae82b28fc">
Aug 26 11:56:28 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 11:56:28 user nova-compute[73068]:         </nova:port>
Aug 26 11:56:28 user nova-compute[73068]:       </nova:ports>
Aug 26 11:56:28 user nova-compute[73068]:     </nova:instance>
Aug 26 11:56:28 user nova-compute[73068]:   </metadata>
Aug 26 11:56:28 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:56:28 user nova-compute[73068]:     <system>
Aug 26 11:56:28 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:56:28 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:56:28 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:56:28 user nova-compute[73068]:       <entry name="serial">d74da117-dc27-46b4-897b-763ef5137a6e</entry>
Aug 26 11:56:28 user nova-compute[73068]:       <entry name="uuid">d74da117-dc27-46b4-897b-763ef5137a6e</entry>
Aug 26 11:56:28 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:56:28 user nova-compute[73068]:     </system>
Aug 26 11:56:28 user nova-compute[73068]:   </sysinfo>
Aug 26 11:56:28 user nova-compute[73068]:   <os>
Aug 26 11:56:28 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:56:28 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:56:28 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:56:28 user nova-compute[73068]:   </os>
Aug 26 11:56:28 user nova-compute[73068]:   <features>
Aug 26 11:56:28 user nova-compute[73068]:     <acpi/>
Aug 26 11:56:28 user nova-compute[73068]:     <apic/>
Aug 26 11:56:28 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:56:28 user nova-compute[73068]:   </features>
Aug 26 11:56:28 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:56:28 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:56:28 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:56:28 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:56:28 user nova-compute[73068]:   </clock>
Aug 26 11:56:28 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:56:28 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:56:28 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:56:28 user nova-compute[73068]:   </cpu>
Aug 26 11:56:28 user nova-compute[73068]:   <devices>
Aug 26 11:56:28 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:56:28 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:56:28 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk"/>
Aug 26 11:56:28 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:56:28 user nova-compute[73068]:     </disk>
Aug 26 11:56:28 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:56:28 user nova-compute[73068]:       <mac address="fa:16:3e:cc:9c:22"/>
Aug 26 11:56:28 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:56:28 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:56:28 user nova-compute[73068]:       <target dev="tap45871af6-d0"/>
Aug 26 11:56:28 user nova-compute[73068]:     </interface>
Aug 26 11:56:28 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:56:28 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/console.log" append="off"/>
Aug 26 11:56:28 user nova-compute[73068]:     </serial>
Aug 26 11:56:28 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:56:28 user nova-compute[73068]:     <video>
Aug 26 11:56:28 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:56:28 user nova-compute[73068]:     </video>
Aug 26 11:56:28 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:56:28 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:56:28 user nova-compute[73068]:     </rng>
Aug 26 11:56:28 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:56:28 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:56:28 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:56:28 user nova-compute[73068]:     </memballoon>
Aug 26 11:56:28 user nova-compute[73068]:   </devices>
Aug 26 11:56:28 user nova-compute[73068]: </domain>
Aug 26 11:56:28 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377830885',display_name='tempest-AttachVolumeTestJSON-server-1377830885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377830885',id=37,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsxnls5pSWEI8tJVRT6XWjo8knb/jw0ioODazScLyVBvBW14Z0xQMwhMlQpp6ZzwSSw+lOZfha1HXkAXljtsOPpxp0R24dQGyfOMkRm/2F2mL2mWcUIC5gdQeoyHYxoHg==',key_name='tempest-keypair-620631342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-03k6g0wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:56:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=d74da117-dc27-46b4-897b-763ef5137a6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45871af6-d08f-40df-bc66-24eae82b28fc", "address": "fa:16:3e:cc:9c:22", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45871af6-d0", "ovs_interfaceid": "45871af6-d08f-40df-bc66-24eae82b28fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "45871af6-d08f-40df-bc66-24eae82b28fc", "address": "fa:16:3e:cc:9c:22", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45871af6-d0", "ovs_interfaceid": "45871af6-d08f-40df-bc66-24eae82b28fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:22,bridge_name='br-int',has_traffic_filtering=True,id=45871af6-d08f-40df-bc66-24eae82b28fc,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45871af6-d0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG os_vif [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:22,bridge_name='br-int',has_traffic_filtering=True,id=45871af6-d08f-40df-bc66-24eae82b28fc,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45871af6-d0') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45871af6-d0, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45871af6-d0, col_values=(('external_ids', {'iface-id': '45871af6-d08f-40df-bc66-24eae82b28fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:9c:22', 'vm-uuid': 'd74da117-dc27-46b4-897b-763ef5137a6e'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:28 user nova-compute[73068]: INFO os_vif [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9c:22,bridge_name='br-int',has_traffic_filtering=True,id=45871af6-d08f-40df-bc66-24eae82b28fc,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45871af6-d0')
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No VIF found with MAC fa:16:3e:cc:9c:22, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.476s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:28 user nova-compute[73068]: INFO nova.compute.manager [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Migrating
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:56:28 user nova-compute[73068]: INFO nova.compute.rpcapi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquired lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-b54b269a-022a-4a04-849b-8cc038e4b94f req-747753be-52d1-400d-ab94-34bc352c4041 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Updated VIF entry in instance network info cache for port 45871af6-d08f-40df-bc66-24eae82b28fc. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-b54b269a-022a-4a04-849b-8cc038e4b94f req-747753be-52d1-400d-ab94-34bc352c4041 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Updating instance_info_cache with network_info: [{"id": "45871af6-d08f-40df-bc66-24eae82b28fc", "address": "fa:16:3e:cc:9c:22", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45871af6-d0", "ovs_interfaceid": "45871af6-d08f-40df-bc66-24eae82b28fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:56:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b54b269a-022a-4a04-849b-8cc038e4b94f req-747753be-52d1-400d-ab94-34bc352c4041 service nova] Releasing lock "refresh_cache-d74da117-dc27-46b4-897b-763ef5137a6e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:56:29 user nova-compute[73068]: DEBUG nova.network.neutron [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating instance_info_cache with network_info: [{"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:56:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Releasing lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:56:29 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Starting migrate_disk_and_power_off {{(pid=73068) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 11:56:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-4cb87f59-5d33-436a-a099-40c41798fc3a req-46be6084-5c05-40ca-8729-e3e252225430 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4cb87f59-5d33-436a-a099-40c41798fc3a req-46be6084-5c05-40ca-8729-e3e252225430 service nova] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4cb87f59-5d33-436a-a099-40c41798fc3a req-46be6084-5c05-40ca-8729-e3e252225430 service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4cb87f59-5d33-436a-a099-40c41798fc3a req-46be6084-5c05-40ca-8729-e3e252225430 service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-4cb87f59-5d33-436a-a099-40c41798fc3a req-46be6084-5c05-40ca-8729-e3e252225430 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] No waiting events found dispatching network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:56:30 user nova-compute[73068]: WARNING nova.compute.manager [req-4cb87f59-5d33-436a-a099-40c41798fc3a req-46be6084-5c05-40ca-8729-e3e252225430 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received unexpected event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc for instance with vm_state building and task_state spawning.
Aug 26 11:56:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-f403ed36-18fc-4d09-8a0b-bb7fe56f19bb req-67087b9c-2386-4167-8a43-c5601578d10b service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-vif-unplugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f403ed36-18fc-4d09-8a0b-bb7fe56f19bb req-67087b9c-2386-4167-8a43-c5601578d10b service nova] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f403ed36-18fc-4d09-8a0b-bb7fe56f19bb req-67087b9c-2386-4167-8a43-c5601578d10b service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f403ed36-18fc-4d09-8a0b-bb7fe56f19bb req-67087b9c-2386-4167-8a43-c5601578d10b service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-f403ed36-18fc-4d09-8a0b-bb7fe56f19bb req-67087b9c-2386-4167-8a43-c5601578d10b service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] No waiting events found dispatching network-vif-unplugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:56:30 user nova-compute[73068]: WARNING nova.compute.manager [req-f403ed36-18fc-4d09-8a0b-bb7fe56f19bb req-67087b9c-2386-4167-8a43-c5601578d10b service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received unexpected event network-vif-unplugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 for instance with vm_state active and task_state resize_migrating.
Aug 26 11:56:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Instance destroyed successfully.
Aug 26 11:56:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905538226',display_name='tempest-ServerActionsTestOtherA-server-1905538226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905538226',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEidFbMuWm3Ff85RQNGqsibmn5TiGb1b1MKD1SbY+915mQ5QKEZYxmDBFmRdORKitoTVm8qIYWV2p9ti1GszyrhsioU3qq34YTLHcZIRxComRJG1yG+FKs8AGlXLqDxQ4Q==',key_name='tempest-keypair-1757051288',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-f38l2awy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:56:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=1af1b911-507d-4303-bf15-b0ebc8b86665,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1205273074-network", "vif_mac": "fa:16:3e:00:2b:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1205273074-network", "vif_mac": "fa:16:3e:00:2b:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_vif [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d3b234c-89, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:56:30 user nova-compute[73068]: INFO os_vif [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89')
Aug 26 11:56:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcQIOspx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:56:30 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aceb7e-595d-412c-98a8-0f8a13741317]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf27364-a25c-40f0-aae6-2243278cc25a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:56:30 user nova-compute[73068]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:56:30 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:56:30 user nova-compute[73068]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:56:30 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9036a830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca098341-f2fe-4072-b6d0-91d5d1e091d3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ec53ba-71eb-4db7-8f58-1f9814d7a4d4]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7086dafd-838b-4591-996c-bad2ec846cff]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf6a9a1-021f-4f8e-a5b3-f96ac81d5ec5]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8c4b76-c33f-439b-a7f5-e0d3e5035115]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6f8023-3d91-4f55-b03b-16844cd6e958]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260]
Aug 26 11:56:30 user nova-compute[73068]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260] successful.
Aug 26 11:56:30 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29e9d75-832a-4f1d-9c76-47d78c8f14e1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== disconnect_volume: return (335ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:56:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:31 user nova-compute[73068]: DEBUG nova.network.neutron [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Port 8d3b234c-893e-43c5-97f2-48ec745d9fb5 binding to destination host user is already ACTIVE {{(pid=73068) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-900799f8-3265-4968-96a9-52a3cf2bc699 req-c160512a-2bcf-4652-a6ae-b3452939cdf7 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-900799f8-3265-4968-96a9-52a3cf2bc699 req-c160512a-2bcf-4652-a6ae-b3452939cdf7 service nova] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-900799f8-3265-4968-96a9-52a3cf2bc699 req-c160512a-2bcf-4652-a6ae-b3452939cdf7 service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-900799f8-3265-4968-96a9-52a3cf2bc699 req-c160512a-2bcf-4652-a6ae-b3452939cdf7 service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-900799f8-3265-4968-96a9-52a3cf2bc699 req-c160512a-2bcf-4652-a6ae-b3452939cdf7 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] No waiting events found dispatching network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:56:32 user nova-compute[73068]: WARNING nova.compute.manager [req-900799f8-3265-4968-96a9-52a3cf2bc699 req-c160512a-2bcf-4652-a6ae-b3452939cdf7 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received unexpected event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc for instance with vm_state building and task_state spawning.
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050992.1586158, d74da117-dc27-46b4-897b-763ef5137a6e => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:56:32 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] VM Resumed (Lifecycle Event)
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:56:32 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Instance spawned successfully.
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-d761d1d1-d646-44da-99e2-47c5e9274f36 req-d0581db4-f27a-405b-865b-f1869feaf6ce service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d761d1d1-d646-44da-99e2-47c5e9274f36 req-d0581db4-f27a-405b-865b-f1869feaf6ce service nova] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d761d1d1-d646-44da-99e2-47c5e9274f36 req-d0581db4-f27a-405b-865b-f1869feaf6ce service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.011s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d761d1d1-d646-44da-99e2-47c5e9274f36 req-d0581db4-f27a-405b-865b-f1869feaf6ce service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-d761d1d1-d646-44da-99e2-47c5e9274f36 req-d0581db4-f27a-405b-865b-f1869feaf6ce service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] No waiting events found dispatching network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:56:32 user nova-compute[73068]: WARNING nova.compute.manager [req-d761d1d1-d646-44da-99e2-47c5e9274f36 req-d0581db4-f27a-405b-865b-f1869feaf6ce service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received unexpected event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 for instance with vm_state active and task_state resize_migrated.
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:32 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693050992.1600316, d74da117-dc27-46b4-897b-763ef5137a6e => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:56:32 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] VM Started (Lifecycle Event)
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquired lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.network.neutron [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:56:32 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:56:32 user nova-compute[73068]: INFO nova.compute.manager [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Took 8.02 seconds to spawn the instance on the hypervisor.
Aug 26 11:56:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:56:32 user nova-compute[73068]: INFO nova.compute.manager [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Took 8.76 seconds to build instance.
Aug 26 11:56:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7f206d59-b1cf-451d-9a8c-54f97577a114 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.892s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG nova.network.neutron [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating instance_info_cache with network_info: [{"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Releasing lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG os_brick.utils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[637324b5-934d-44df-ac7c-a4bc03cceba5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[48033ca5-599e-454b-8040-6a80097ac027]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f3250b-34e1-49f7-a15b-cfb57389a65e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8505244-7f57-4631-8993-ef56c7891ca3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:56:33 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:56:33 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbd08f6-7846-40b3-a177-4e9bea66ff0d]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:56:33 user nova-compute[73068]: DEBUG os_brick.utils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:56:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:56:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:56:36 user nova-compute[73068]: INFO nova.compute.claims [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Claim successful on node user
Aug 26 11:56:37 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:56:37 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:56:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:56:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:56:37 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:56:37 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:56:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:56:37 user nova-compute[73068]: DEBUG nova.policy [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ac10e83704b4b6e95d66739f6aab12b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acb7739d15924faba2b87a6929e91009', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:56:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:56:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:56:37 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Creating image(s)
Aug 26 11:56:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "/opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "/opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "/opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.208s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk 1073741824" returned: 0 in 0.078s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Successfully created port: 19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Cannot resize image /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Ensure instance console log exists: /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Successfully updated port: 19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:56:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "refresh_cache-f024a327-fe6d-4599-9d04-94f7dc54e646" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:56:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquired lock "refresh_cache-f024a327-fe6d-4599-9d04-94f7dc54e646" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:56:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:56:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-a99cfe92-e74f-47a7-ac2a-0d2f5e8fe1bf req-eb2864e7-449e-4366-910d-bad1c50b567d service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Received event network-changed-19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-a99cfe92-e74f-47a7-ac2a-0d2f5e8fe1bf req-eb2864e7-449e-4366-910d-bad1c50b567d service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Refreshing instance network info cache due to event network-changed-19513704-e0e6-4e4b-92b4-354893c9fa27. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:56:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a99cfe92-e74f-47a7-ac2a-0d2f5e8fe1bf req-eb2864e7-449e-4366-910d-bad1c50b567d service nova] Acquiring lock "refresh_cache-f024a327-fe6d-4599-9d04-94f7dc54e646" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:56:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Updating instance_info_cache with network_info: [{"id": "19513704-e0e6-4e4b-92b4-354893c9fa27", "address": "fa:16:3e:a6:4b:b1", "network": {"id": "983a876f-5f9d-4528-aed3-d3d03297deb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518423548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acb7739d15924faba2b87a6929e91009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19513704-e0", "ovs_interfaceid": "19513704-e0e6-4e4b-92b4-354893c9fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Releasing lock "refresh_cache-f024a327-fe6d-4599-9d04-94f7dc54e646" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Instance network_info: |[{"id": "19513704-e0e6-4e4b-92b4-354893c9fa27", "address": "fa:16:3e:a6:4b:b1", "network": {"id": "983a876f-5f9d-4528-aed3-d3d03297deb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518423548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acb7739d15924faba2b87a6929e91009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19513704-e0", "ovs_interfaceid": "19513704-e0e6-4e4b-92b4-354893c9fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a99cfe92-e74f-47a7-ac2a-0d2f5e8fe1bf req-eb2864e7-449e-4366-910d-bad1c50b567d service nova] Acquired lock "refresh_cache-f024a327-fe6d-4599-9d04-94f7dc54e646" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.network.neutron [req-a99cfe92-e74f-47a7-ac2a-0d2f5e8fe1bf req-eb2864e7-449e-4366-910d-bad1c50b567d service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Refreshing network info cache for port 19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Start _get_guest_xml network_info=[{"id": "19513704-e0e6-4e4b-92b4-354893c9fa27", "address": "fa:16:3e:a6:4b:b1", "network": {"id": "983a876f-5f9d-4528-aed3-d3d03297deb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518423548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acb7739d15924faba2b87a6929e91009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19513704-e0", "ovs_interfaceid": "19513704-e0e6-4e4b-92b4-354893c9fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:56:40 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:56:40 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:56:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-423534747',display_name='tempest-TestServerVolumeAttachmentScenario-server-423534747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-423534747',id=38,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt/+AZqFyTSvkSiVxRGy0fF6xcJoYXHfR2HZE2544E4JaubhI5ZP/LqR9Ay/Pympir4ypCxVrOs6leaZs60JKnoWeySEZ6d0xtt5FnEAqMYkKnXKhdsfLqTHNZ8UCImAA==',key_name='tempest-keypair-1912900491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acb7739d15924faba2b87a6929e91009',ramdisk_id='',reservation_id='r-q1f0536l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-874220908',owner_user_name='tempest-TestServerVolumeAttachmentScenario-874220908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ac10e83704b4b6e95d66739f6aab12b',uuid=f024a327-fe6d-4599-9d04-94f7dc54e646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19513704-e0e6-4e4b-92b4-354893c9fa27", "address": "fa:16:3e:a6:4b:b1", "network": {"id": "983a876f-5f9d-4528-aed3-d3d03297deb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518423548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acb7739d15924faba2b87a6929e91009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19513704-e0", "ovs_interfaceid": "19513704-e0e6-4e4b-92b4-354893c9fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Converting VIF {"id": "19513704-e0e6-4e4b-92b4-354893c9fa27", "address": "fa:16:3e:a6:4b:b1", "network": {"id": "983a876f-5f9d-4528-aed3-d3d03297deb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518423548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acb7739d15924faba2b87a6929e91009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19513704-e0", "ovs_interfaceid": "19513704-e0e6-4e4b-92b4-354893c9fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4b:b1,bridge_name='br-int',has_traffic_filtering=True,id=19513704-e0e6-4e4b-92b4-354893c9fa27,network=Network(983a876f-5f9d-4528-aed3-d3d03297deb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19513704-e0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.objects.instance [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lazy-loading 'pci_devices' on Instance uuid f024a327-fe6d-4599-9d04-94f7dc54e646 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:56:40 user nova-compute[73068]:   <uuid>f024a327-fe6d-4599-9d04-94f7dc54e646</uuid>
Aug 26 11:56:40 user nova-compute[73068]:   <name>instance-00000026</name>
Aug 26 11:56:40 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:56:40 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:56:40 user nova-compute[73068]:   <metadata>
Aug 26 11:56:40 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:56:40 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:56:40 user nova-compute[73068]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-423534747</nova:name>
Aug 26 11:56:40 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:56:40</nova:creationTime>
Aug 26 11:56:40 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:56:40 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:56:40 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:56:40 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:56:40 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:56:40 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:56:40 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:56:40 user nova-compute[73068]:       <nova:owner>
Aug 26 11:56:40 user nova-compute[73068]:         <nova:user uuid="4ac10e83704b4b6e95d66739f6aab12b">tempest-TestServerVolumeAttachmentScenario-874220908-project-member</nova:user>
Aug 26 11:56:40 user nova-compute[73068]:         <nova:project uuid="acb7739d15924faba2b87a6929e91009">tempest-TestServerVolumeAttachmentScenario-874220908</nova:project>
Aug 26 11:56:40 user nova-compute[73068]:       </nova:owner>
Aug 26 11:56:40 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:56:40 user nova-compute[73068]:       <nova:ports>
Aug 26 11:56:40 user nova-compute[73068]:         <nova:port uuid="19513704-e0e6-4e4b-92b4-354893c9fa27">
Aug 26 11:56:40 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 11:56:40 user nova-compute[73068]:         </nova:port>
Aug 26 11:56:40 user nova-compute[73068]:       </nova:ports>
Aug 26 11:56:40 user nova-compute[73068]:     </nova:instance>
Aug 26 11:56:40 user nova-compute[73068]:   </metadata>
Aug 26 11:56:40 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:56:40 user nova-compute[73068]:     <system>
Aug 26 11:56:40 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:56:40 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:56:40 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:56:40 user nova-compute[73068]:       <entry name="serial">f024a327-fe6d-4599-9d04-94f7dc54e646</entry>
Aug 26 11:56:40 user nova-compute[73068]:       <entry name="uuid">f024a327-fe6d-4599-9d04-94f7dc54e646</entry>
Aug 26 11:56:40 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:56:40 user nova-compute[73068]:     </system>
Aug 26 11:56:40 user nova-compute[73068]:   </sysinfo>
Aug 26 11:56:40 user nova-compute[73068]:   <os>
Aug 26 11:56:40 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:56:40 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:56:40 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:56:40 user nova-compute[73068]:   </os>
Aug 26 11:56:40 user nova-compute[73068]:   <features>
Aug 26 11:56:40 user nova-compute[73068]:     <acpi/>
Aug 26 11:56:40 user nova-compute[73068]:     <apic/>
Aug 26 11:56:40 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:56:40 user nova-compute[73068]:   </features>
Aug 26 11:56:40 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:56:40 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:56:40 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:56:40 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:56:40 user nova-compute[73068]:   </clock>
Aug 26 11:56:40 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:56:40 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:56:40 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:56:40 user nova-compute[73068]:   </cpu>
Aug 26 11:56:40 user nova-compute[73068]:   <devices>
Aug 26 11:56:40 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:56:40 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:56:40 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk"/>
Aug 26 11:56:40 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:56:40 user nova-compute[73068]:     </disk>
Aug 26 11:56:40 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:56:40 user nova-compute[73068]:       <mac address="fa:16:3e:a6:4b:b1"/>
Aug 26 11:56:40 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:56:40 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:56:40 user nova-compute[73068]:       <target dev="tap19513704-e0"/>
Aug 26 11:56:40 user nova-compute[73068]:     </interface>
Aug 26 11:56:40 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:56:40 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/console.log" append="off"/>
Aug 26 11:56:40 user nova-compute[73068]:     </serial>
Aug 26 11:56:40 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:56:40 user nova-compute[73068]:     <video>
Aug 26 11:56:40 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:56:40 user nova-compute[73068]:     </video>
Aug 26 11:56:40 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:56:40 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:56:40 user nova-compute[73068]:     </rng>
Aug 26 11:56:40 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:56:40 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:56:40 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:56:40 user nova-compute[73068]:     </memballoon>
Aug 26 11:56:40 user nova-compute[73068]:   </devices>
Aug 26 11:56:40 user nova-compute[73068]: </domain>
Aug 26 11:56:40 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:56:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-423534747',display_name='tempest-TestServerVolumeAttachmentScenario-server-423534747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-423534747',id=38,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt/+AZqFyTSvkSiVxRGy0fF6xcJoYXHfR2HZE2544E4JaubhI5ZP/LqR9Ay/Pympir4ypCxVrOs6leaZs60JKnoWeySEZ6d0xtt5FnEAqMYkKnXKhdsfLqTHNZ8UCImAA==',key_name='tempest-keypair-1912900491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acb7739d15924faba2b87a6929e91009',ramdisk_id='',reservation_id='r-q1f0536l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-874220908',owner_user_name='tempest-TestServerVolumeAttachmentScenario-874220908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ac10e83704b4b6e95d66739f6aab12b',uuid=f024a327-fe6d-4599-9d04-94f7dc54e646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19513704-e0e6-4e4b-92b4-354893c9fa27", "address": "fa:16:3e:a6:4b:b1", "network": {"id": "983a876f-5f9d-4528-aed3-d3d03297deb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518423548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acb7739d15924faba2b87a6929e91009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19513704-e0", "ovs_interfaceid": "19513704-e0e6-4e4b-92b4-354893c9fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Converting VIF {"id": "19513704-e0e6-4e4b-92b4-354893c9fa27", "address": "fa:16:3e:a6:4b:b1", "network": {"id": "983a876f-5f9d-4528-aed3-d3d03297deb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518423548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acb7739d15924faba2b87a6929e91009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19513704-e0", "ovs_interfaceid": "19513704-e0e6-4e4b-92b4-354893c9fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4b:b1,bridge_name='br-int',has_traffic_filtering=True,id=19513704-e0e6-4e4b-92b4-354893c9fa27,network=Network(983a876f-5f9d-4528-aed3-d3d03297deb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19513704-e0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG os_vif [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4b:b1,bridge_name='br-int',has_traffic_filtering=True,id=19513704-e0e6-4e4b-92b4-354893c9fa27,network=Network(983a876f-5f9d-4528-aed3-d3d03297deb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19513704-e0') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19513704-e0, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19513704-e0, col_values=(('external_ids', {'iface-id': '19513704-e0e6-4e4b-92b4-354893c9fa27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:4b:b1', 'vm-uuid': 'f024a327-fe6d-4599-9d04-94f7dc54e646'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:40 user nova-compute[73068]: INFO os_vif [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4b:b1,bridge_name='br-int',has_traffic_filtering=True,id=19513704-e0e6-4e4b-92b4-354893c9fa27,network=Network(983a876f-5f9d-4528-aed3-d3d03297deb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19513704-e0')
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] No VIF found with MAC fa:16:3e:a6:4b:b1, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.network.neutron [req-a99cfe92-e74f-47a7-ac2a-0d2f5e8fe1bf req-eb2864e7-449e-4366-910d-bad1c50b567d service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Updated VIF entry in instance network info cache for port 19513704-e0e6-4e4b-92b4-354893c9fa27. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG nova.network.neutron [req-a99cfe92-e74f-47a7-ac2a-0d2f5e8fe1bf req-eb2864e7-449e-4366-910d-bad1c50b567d service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Updating instance_info_cache with network_info: [{"id": "19513704-e0e6-4e4b-92b4-354893c9fa27", "address": "fa:16:3e:a6:4b:b1", "network": {"id": "983a876f-5f9d-4528-aed3-d3d03297deb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518423548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acb7739d15924faba2b87a6929e91009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19513704-e0", "ovs_interfaceid": "19513704-e0e6-4e4b-92b4-354893c9fa27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a99cfe92-e74f-47a7-ac2a-0d2f5e8fe1bf req-eb2864e7-449e-4366-910d-bad1c50b567d service nova] Releasing lock "refresh_cache-f024a327-fe6d-4599-9d04-94f7dc54e646" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:56:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-43ee0125-2e91-4d85-8fc8-3dce1b24f107 req-87d763e3-0ca1-422f-be30-b88fdd5aaceb service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Received event network-vif-plugged-19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-43ee0125-2e91-4d85-8fc8-3dce1b24f107 req-87d763e3-0ca1-422f-be30-b88fdd5aaceb service nova] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-43ee0125-2e91-4d85-8fc8-3dce1b24f107 req-87d763e3-0ca1-422f-be30-b88fdd5aaceb service nova] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-43ee0125-2e91-4d85-8fc8-3dce1b24f107 req-87d763e3-0ca1-422f-be30-b88fdd5aaceb service nova] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-43ee0125-2e91-4d85-8fc8-3dce1b24f107 req-87d763e3-0ca1-422f-be30-b88fdd5aaceb service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] No waiting events found dispatching network-vif-plugged-19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:56:41 user nova-compute[73068]: WARNING nova.compute.manager [req-43ee0125-2e91-4d85-8fc8-3dce1b24f107 req-87d763e3-0ca1-422f-be30-b88fdd5aaceb service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Received unexpected event network-vif-plugged-19513704-e0e6-4e4b-92b4-354893c9fa27 for instance with vm_state building and task_state spawning.
Aug 26 11:56:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-615b1cf9-bdd7-4904-a992-374a7ab31cc5 req-466de297-6539-4675-8af7-c57e2f2c94c4 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Received event network-vif-plugged-19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-615b1cf9-bdd7-4904-a992-374a7ab31cc5 req-466de297-6539-4675-8af7-c57e2f2c94c4 service nova] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-615b1cf9-bdd7-4904-a992-374a7ab31cc5 req-466de297-6539-4675-8af7-c57e2f2c94c4 service nova] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-615b1cf9-bdd7-4904-a992-374a7ab31cc5 req-466de297-6539-4675-8af7-c57e2f2c94c4 service nova] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-615b1cf9-bdd7-4904-a992-374a7ab31cc5 req-466de297-6539-4675-8af7-c57e2f2c94c4 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] No waiting events found dispatching network-vif-plugged-19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:56:43 user nova-compute[73068]: WARNING nova.compute.manager [req-615b1cf9-bdd7-4904-a992-374a7ab31cc5 req-466de297-6539-4675-8af7-c57e2f2c94c4 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Received unexpected event network-vif-plugged-19513704-e0e6-4e4b-92b4-354893c9fa27 for instance with vm_state building and task_state spawning.
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051003.9033077, f024a327-fe6d-4599-9d04-94f7dc54e646 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:56:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] VM Resumed (Lifecycle Event)
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:56:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Instance spawned successfully.
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:56:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051003.9035568, f024a327-fe6d-4599-9d04-94f7dc54e646 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:56:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] VM Started (Lifecycle Event)
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:56:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:56:44 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:56:44 user nova-compute[73068]: INFO nova.compute.manager [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 26 11:56:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:56:44 user nova-compute[73068]: INFO nova.compute.manager [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Took 7.32 seconds to build instance.
Aug 26 11:56:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2a2b2447-4324-4328-914e-166794406d3b tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.448s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693050990.3641458, 1af1b911-507d-4303-bf15-b0ebc8b86665 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:56:45 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] VM Stopped (Lifecycle Event)
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-dc61c2a6-361e-4751-bab7-4c4b88a28754 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-dc61c2a6-361e-4751-bab7-4c4b88a28754 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:56:45 user nova-compute[73068]: INFO nova.compute.manager [None req-dc61c2a6-361e-4751-bab7-4c4b88a28754 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Starting finish_migration {{(pid=73068) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Instance directory exists: not creating {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 11:56:45 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Creating image(s)
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Ensure instance console log exists: /opt/stack/data/nova/instances/1af1b911-507d-4303-bf15-b0ebc8b86665/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Start _get_guest_xml network_info=[{"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1205273074-network", "vif_mac": "fa:16:3e:00:2b:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'a807b4f5-c34e-4dab-91cf-e8a3dd9298a3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcQIOspx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1af1b911-507d-4303-bf15-b0ebc8b86665', 'attached_at': '2023-08-26T11:56:45.000000', 'detached_at': '', 'volume_id': 'd1c371cd-af08-4bf5-afc2-3a3ad3e0bf46', 'serial': 'd1c371cd-af08-4bf5-afc2-3a3ad3e0bf46'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:56:45 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:56:45 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcQIOspx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:56:45 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:56:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:56:45 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:56:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:56:45 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e63362-d84d-487a-9f0c-d907365efe4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:56:45 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebeec8d-4186-4316-b3d9-cd45b98bbb6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46] added
Aug 26 11:56:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0325bfce-bdcb-496b-9986-57b8b228be7f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.162s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[288a2219-153c-4e5d-aac4-58da84c7c3a8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcQIOspx {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UcQIOspx" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181f080-2bd4-40d8-ae1b-c3282e51364e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UcQIOspx'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:56:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e8b188-4832-4397-a30a-b0ab1bf537c3]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07051d2-2ac0-4f4c-9fd8-92bcc4fc0505]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:56:46 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:56:46 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[280c5e21-6015-4702-afa3-cb718e4a295f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260]
Aug 26 11:56:46 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260] successful.
Aug 26 11:56:46 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[541b88e4-bd4a-4d70-8c8f-f172d3cb4077]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a6264d-11e8-4327-a93d-a54c4ddd2ef3]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:56:46 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:56:46 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:56:46 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:56:46 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca464d-2dc3-4123-9835-1c8cfb0c6ede]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:56:46 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcQIOspx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '23031303938376233', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031303938376233', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905538226',display_name='tempest-ServerActionsTestOtherA-server-1905538226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905538226',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEidFbMuWm3Ff85RQNGqsibmn5TiGb1b1MKD1SbY+915mQ5QKEZYxmDBFmRdORKitoTVm8qIYWV2p9ti1GszyrhsioU3qq34YTLHcZIRxComRJG1yG+FKs8AGlXLqDxQ4Q==',key_name='tempest-keypair-1757051288',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-f38l2awy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:56:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=1af1b911-507d-4303-bf15-b0ebc8b86665,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1205273074-network", "vif_mac": "fa:16:3e:00:2b:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1205273074-network", "vif_mac": "fa:16:3e:00:2b:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:56:47 user nova-compute[73068]:   <uuid>1af1b911-507d-4303-bf15-b0ebc8b86665</uuid>
Aug 26 11:56:47 user nova-compute[73068]:   <name>instance-00000023</name>
Aug 26 11:56:47 user nova-compute[73068]:   <memory>2097152</memory>
Aug 26 11:56:47 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:56:47 user nova-compute[73068]:   <metadata>
Aug 26 11:56:47 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:56:47 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:56:47 user nova-compute[73068]:       <nova:name>tempest-ServerActionsTestOtherA-server-1905538226</nova:name>
Aug 26 11:56:47 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:56:45</nova:creationTime>
Aug 26 11:56:47 user nova-compute[73068]:       <nova:flavor name="m1.small">
Aug 26 11:56:47 user nova-compute[73068]:         <nova:memory>2048</nova:memory>
Aug 26 11:56:47 user nova-compute[73068]:         <nova:disk>20</nova:disk>
Aug 26 11:56:47 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:56:47 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:56:47 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:56:47 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:56:47 user nova-compute[73068]:       <nova:owner>
Aug 26 11:56:47 user nova-compute[73068]:         <nova:user uuid="9dbdaab1cbb4446b8709fe4526c10317">tempest-ServerActionsTestOtherA-281587706-project-member</nova:user>
Aug 26 11:56:47 user nova-compute[73068]:         <nova:project uuid="b517fdd290f5457f99b6cc9423a809b5">tempest-ServerActionsTestOtherA-281587706</nova:project>
Aug 26 11:56:47 user nova-compute[73068]:       </nova:owner>
Aug 26 11:56:47 user nova-compute[73068]:       <nova:ports>
Aug 26 11:56:47 user nova-compute[73068]:         <nova:port uuid="8d3b234c-893e-43c5-97f2-48ec745d9fb5">
Aug 26 11:56:47 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 11:56:47 user nova-compute[73068]:         </nova:port>
Aug 26 11:56:47 user nova-compute[73068]:       </nova:ports>
Aug 26 11:56:47 user nova-compute[73068]:     </nova:instance>
Aug 26 11:56:47 user nova-compute[73068]:   </metadata>
Aug 26 11:56:47 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:56:47 user nova-compute[73068]:     <system>
Aug 26 11:56:47 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:56:47 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:56:47 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:56:47 user nova-compute[73068]:       <entry name="serial">1af1b911-507d-4303-bf15-b0ebc8b86665</entry>
Aug 26 11:56:47 user nova-compute[73068]:       <entry name="uuid">1af1b911-507d-4303-bf15-b0ebc8b86665</entry>
Aug 26 11:56:47 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:56:47 user nova-compute[73068]:     </system>
Aug 26 11:56:47 user nova-compute[73068]:   </sysinfo>
Aug 26 11:56:47 user nova-compute[73068]:   <os>
Aug 26 11:56:47 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:56:47 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:56:47 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:56:47 user nova-compute[73068]:   </os>
Aug 26 11:56:47 user nova-compute[73068]:   <features>
Aug 26 11:56:47 user nova-compute[73068]:     <acpi/>
Aug 26 11:56:47 user nova-compute[73068]:     <apic/>
Aug 26 11:56:47 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:56:47 user nova-compute[73068]:   </features>
Aug 26 11:56:47 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:56:47 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:56:47 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:56:47 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:56:47 user nova-compute[73068]:   </clock>
Aug 26 11:56:47 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:56:47 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:56:47 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:56:47 user nova-compute[73068]:   </cpu>
Aug 26 11:56:47 user nova-compute[73068]:   <devices>
Aug 26 11:56:47 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:56:47 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:56:47 user nova-compute[73068]:       <source dev="/dev/sdc"/>
Aug 26 11:56:47 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:56:47 user nova-compute[73068]:       <serial>d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46</serial>
Aug 26 11:56:47 user nova-compute[73068]:     </disk>
Aug 26 11:56:47 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:56:47 user nova-compute[73068]:       <mac address="fa:16:3e:00:2b:89"/>
Aug 26 11:56:47 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:56:47 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:56:47 user nova-compute[73068]:       <target dev="tap8d3b234c-89"/>
Aug 26 11:56:47 user nova-compute[73068]:     </interface>
Aug 26 11:56:47 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:56:47 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/1af1b911-507d-4303-bf15-b0ebc8b86665/console.log" append="off"/>
Aug 26 11:56:47 user nova-compute[73068]:     </serial>
Aug 26 11:56:47 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:56:47 user nova-compute[73068]:     <video>
Aug 26 11:56:47 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:56:47 user nova-compute[73068]:     </video>
Aug 26 11:56:47 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:56:47 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:56:47 user nova-compute[73068]:     </rng>
Aug 26 11:56:47 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:56:47 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:56:47 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:56:47 user nova-compute[73068]:     </memballoon>
Aug 26 11:56:47 user nova-compute[73068]:   </devices>
Aug 26 11:56:47 user nova-compute[73068]: </domain>
Aug 26 11:56:47 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905538226',display_name='tempest-ServerActionsTestOtherA-server-1905538226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905538226',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEidFbMuWm3Ff85RQNGqsibmn5TiGb1b1MKD1SbY+915mQ5QKEZYxmDBFmRdORKitoTVm8qIYWV2p9ti1GszyrhsioU3qq34YTLHcZIRxComRJG1yG+FKs8AGlXLqDxQ4Q==',key_name='tempest-keypair-1757051288',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-f38l2awy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:56:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=1af1b911-507d-4303-bf15-b0ebc8b86665,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1205273074-network", "vif_mac": "fa:16:3e:00:2b:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1205273074-network", "vif_mac": "fa:16:3e:00:2b:89"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG os_vif [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d3b234c-89, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d3b234c-89, col_values=(('external_ids', {'iface-id': '8d3b234c-893e-43c5-97f2-48ec745d9fb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:2b:89', 'vm-uuid': '1af1b911-507d-4303-bf15-b0ebc8b86665'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:47 user nova-compute[73068]: INFO os_vif [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89')
Aug 26 11:56:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:56:47 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] No VIF found with MAC fa:16:3e:00:2b:89, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:56:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-824b76da-2b62-46f4-bdae-837d1f1c7b5a req-9428cf3b-c028-4bb6-9875-6bab8b402968 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-824b76da-2b62-46f4-bdae-837d1f1c7b5a req-9428cf3b-c028-4bb6-9875-6bab8b402968 service nova] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-824b76da-2b62-46f4-bdae-837d1f1c7b5a req-9428cf3b-c028-4bb6-9875-6bab8b402968 service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-824b76da-2b62-46f4-bdae-837d1f1c7b5a req-9428cf3b-c028-4bb6-9875-6bab8b402968 service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-824b76da-2b62-46f4-bdae-837d1f1c7b5a req-9428cf3b-c028-4bb6-9875-6bab8b402968 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] No waiting events found dispatching network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:56:48 user nova-compute[73068]: WARNING nova.compute.manager [req-824b76da-2b62-46f4-bdae-837d1f1c7b5a req-9428cf3b-c028-4bb6-9875-6bab8b402968 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received unexpected event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 for instance with vm_state active and task_state resize_finish.
Aug 26 11:56:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:50 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051010.727794, 1af1b911-507d-4303-bf15-b0ebc8b86665 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:56:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] VM Resumed (Lifecycle Event)
Aug 26 11:56:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:56:50 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Instance running successfully.
Aug 26 11:56:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Failed to set time: agent not configured {{(pid=73068) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 11:56:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-50f8fb90-05a9-4f58-a387-eece0bcd373d tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] finish_migration finished successfully. {{(pid=73068) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 11:56:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:56:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:56:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 11:56:50 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051010.731276, 1af1b911-507d-4303-bf15-b0ebc8b86665 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:56:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] VM Started (Lifecycle Event)
Aug 26 11:56:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:56:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:56:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 11:56:50 user nova-compute[73068]: DEBUG nova.compute.manager [req-31ceae83-fda9-444c-87c8-51d9f07aa71f req-9bcf5199-5086-433a-9e4c-e9eada1ccae7 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:56:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-31ceae83-fda9-444c-87c8-51d9f07aa71f req-9bcf5199-5086-433a-9e4c-e9eada1ccae7 service nova] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:56:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-31ceae83-fda9-444c-87c8-51d9f07aa71f req-9bcf5199-5086-433a-9e4c-e9eada1ccae7 service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:56:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-31ceae83-fda9-444c-87c8-51d9f07aa71f req-9bcf5199-5086-433a-9e4c-e9eada1ccae7 service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:56:50 user nova-compute[73068]: DEBUG nova.compute.manager [req-31ceae83-fda9-444c-87c8-51d9f07aa71f req-9bcf5199-5086-433a-9e4c-e9eada1ccae7 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] No waiting events found dispatching network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:56:50 user nova-compute[73068]: WARNING nova.compute.manager [req-31ceae83-fda9-444c-87c8-51d9f07aa71f req-9bcf5199-5086-433a-9e4c-e9eada1ccae7 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received unexpected event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 for instance with vm_state active and task_state resize_finish.
Aug 26 11:56:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:56:57 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:56:58 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:56:59 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:57:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:57:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:57:01 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:57:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:57:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:57:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:04 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:57:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:57:06 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:57:06 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:57:06 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7925MB free_disk=25.15250015258789GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:57:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Applying migration context for instance 1af1b911-507d-4303-bf15-b0ebc8b86665 as it has an incoming, in-progress migration 8db63efd-8aff-4e3f-acb1-f6db004dda57. Migration status is finished {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 11:57:07 user nova-compute[73068]: INFO nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating resource usage from migration 8db63efd-8aff-4e3f-acb1-f6db004dda57
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance bb9c655d-7e26-45bd-9e28-a695ca25a69b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance d74da117-dc27-46b4-897b-763ef5137a6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Migration 8db63efd-8aff-4e3f-acb1-f6db004dda57 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 1af1b911-507d-4303-bf15-b0ebc8b86665 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance f024a327-fe6d-4599-9d04-94f7dc54e646 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:57:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:57:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:57:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 11:57:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:57:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:57:08 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:57:08 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid a11f0d98-3177-4345-8d54-b76b8a348f21 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:57:09 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updating instance_info_cache with network_info: [{"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:57:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-a11f0d98-3177-4345-8d54-b76b8a348f21" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:57:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:57:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:57:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:57:12 user nova-compute[73068]: INFO nova.compute.claims [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Claim successful on node user
Aug 26 11:57:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG nova.network.neutron [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:57:12 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:57:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG nova.policy [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cd2bf96810a4540969277c8f94d5a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20a527043d44250bfe0a4b9dbf3e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:57:12 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Creating image(s)
Aug 26 11:57:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "/opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "/opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "/opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk 1073741824" returned: 0 in 0.049s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Successfully created port: 9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.207s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Cannot resize image /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Ensure instance console log exists: /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Successfully updated port: 9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "refresh_cache-b148f5b5-ada4-49a6-9e9c-cd04283223ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquired lock "refresh_cache-b148f5b5-ada4-49a6-9e9c-cd04283223ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-e85a7621-7b70-4549-9056-7108e975fb95 req-390b6921-159a-437f-aa91-bfb534bb1cf3 service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Received event network-changed-9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-e85a7621-7b70-4549-9056-7108e975fb95 req-390b6921-159a-437f-aa91-bfb534bb1cf3 service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Refreshing instance network info cache due to event network-changed-9a6af2c1-2262-4553-bd47-ac5f57131fdc. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e85a7621-7b70-4549-9056-7108e975fb95 req-390b6921-159a-437f-aa91-bfb534bb1cf3 service nova] Acquiring lock "refresh_cache-b148f5b5-ada4-49a6-9e9c-cd04283223ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Updating instance_info_cache with network_info: [{"id": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "address": "fa:16:3e:1e:1c:e6", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6af2c1-22", "ovs_interfaceid": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Releasing lock "refresh_cache-b148f5b5-ada4-49a6-9e9c-cd04283223ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Instance network_info: |[{"id": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "address": "fa:16:3e:1e:1c:e6", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6af2c1-22", "ovs_interfaceid": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e85a7621-7b70-4549-9056-7108e975fb95 req-390b6921-159a-437f-aa91-bfb534bb1cf3 service nova] Acquired lock "refresh_cache-b148f5b5-ada4-49a6-9e9c-cd04283223ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.network.neutron [req-e85a7621-7b70-4549-9056-7108e975fb95 req-390b6921-159a-437f-aa91-bfb534bb1cf3 service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Refreshing network info cache for port 9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Start _get_guest_xml network_info=[{"id": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "address": "fa:16:3e:1e:1c:e6", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6af2c1-22", "ovs_interfaceid": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:57:15 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:57:15 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-321180029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-321180029',id=39,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-7if205kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:57:13Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=b148f5b5-ada4-49a6-9e9c-cd04283223ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "address": "fa:16:3e:1e:1c:e6", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6af2c1-22", "ovs_interfaceid": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "address": "fa:16:3e:1e:1c:e6", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6af2c1-22", "ovs_interfaceid": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:1c:e6,bridge_name='br-int',has_traffic_filtering=True,id=9a6af2c1-2262-4553-bd47-ac5f57131fdc,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6af2c1-22') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.objects.instance [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'pci_devices' on Instance uuid b148f5b5-ada4-49a6-9e9c-cd04283223ee {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:57:15 user nova-compute[73068]:   <uuid>b148f5b5-ada4-49a6-9e9c-cd04283223ee</uuid>
Aug 26 11:57:15 user nova-compute[73068]:   <name>instance-00000027</name>
Aug 26 11:57:15 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:57:15 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:57:15 user nova-compute[73068]:   <metadata>
Aug 26 11:57:15 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:57:15 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:57:15 user nova-compute[73068]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-321180029</nova:name>
Aug 26 11:57:15 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:57:15</nova:creationTime>
Aug 26 11:57:15 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:57:15 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:57:15 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:57:15 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:57:15 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:57:15 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:57:15 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:57:15 user nova-compute[73068]:       <nova:owner>
Aug 26 11:57:15 user nova-compute[73068]:         <nova:user uuid="9cd2bf96810a4540969277c8f94d5a6d">tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member</nova:user>
Aug 26 11:57:15 user nova-compute[73068]:         <nova:project uuid="d20a527043d44250bfe0a4b9dbf3e00d">tempest-ServerBootFromVolumeStableRescueTest-343541457</nova:project>
Aug 26 11:57:15 user nova-compute[73068]:       </nova:owner>
Aug 26 11:57:15 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 11:57:15 user nova-compute[73068]:       <nova:ports>
Aug 26 11:57:15 user nova-compute[73068]:         <nova:port uuid="9a6af2c1-2262-4553-bd47-ac5f57131fdc">
Aug 26 11:57:15 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 11:57:15 user nova-compute[73068]:         </nova:port>
Aug 26 11:57:15 user nova-compute[73068]:       </nova:ports>
Aug 26 11:57:15 user nova-compute[73068]:     </nova:instance>
Aug 26 11:57:15 user nova-compute[73068]:   </metadata>
Aug 26 11:57:15 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:57:15 user nova-compute[73068]:     <system>
Aug 26 11:57:15 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:57:15 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:57:15 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:57:15 user nova-compute[73068]:       <entry name="serial">b148f5b5-ada4-49a6-9e9c-cd04283223ee</entry>
Aug 26 11:57:15 user nova-compute[73068]:       <entry name="uuid">b148f5b5-ada4-49a6-9e9c-cd04283223ee</entry>
Aug 26 11:57:15 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:57:15 user nova-compute[73068]:     </system>
Aug 26 11:57:15 user nova-compute[73068]:   </sysinfo>
Aug 26 11:57:15 user nova-compute[73068]:   <os>
Aug 26 11:57:15 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:57:15 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:57:15 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:57:15 user nova-compute[73068]:   </os>
Aug 26 11:57:15 user nova-compute[73068]:   <features>
Aug 26 11:57:15 user nova-compute[73068]:     <acpi/>
Aug 26 11:57:15 user nova-compute[73068]:     <apic/>
Aug 26 11:57:15 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:57:15 user nova-compute[73068]:   </features>
Aug 26 11:57:15 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:57:15 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:57:15 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:57:15 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:57:15 user nova-compute[73068]:   </clock>
Aug 26 11:57:15 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:57:15 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:57:15 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:57:15 user nova-compute[73068]:   </cpu>
Aug 26 11:57:15 user nova-compute[73068]:   <devices>
Aug 26 11:57:15 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 11:57:15 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 11:57:15 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk"/>
Aug 26 11:57:15 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:57:15 user nova-compute[73068]:     </disk>
Aug 26 11:57:15 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:57:15 user nova-compute[73068]:       <mac address="fa:16:3e:1e:1c:e6"/>
Aug 26 11:57:15 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:57:15 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:57:15 user nova-compute[73068]:       <target dev="tap9a6af2c1-22"/>
Aug 26 11:57:15 user nova-compute[73068]:     </interface>
Aug 26 11:57:15 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:57:15 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/console.log" append="off"/>
Aug 26 11:57:15 user nova-compute[73068]:     </serial>
Aug 26 11:57:15 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:57:15 user nova-compute[73068]:     <video>
Aug 26 11:57:15 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:57:15 user nova-compute[73068]:     </video>
Aug 26 11:57:15 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:57:15 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:57:15 user nova-compute[73068]:     </rng>
Aug 26 11:57:15 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:57:15 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:57:15 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:57:15 user nova-compute[73068]:     </memballoon>
Aug 26 11:57:15 user nova-compute[73068]:   </devices>
Aug 26 11:57:15 user nova-compute[73068]: </domain>
Aug 26 11:57:15 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-321180029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-321180029',id=39,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-7if205kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:57:13Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=b148f5b5-ada4-49a6-9e9c-cd04283223ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "address": "fa:16:3e:1e:1c:e6", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6af2c1-22", "ovs_interfaceid": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "address": "fa:16:3e:1e:1c:e6", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6af2c1-22", "ovs_interfaceid": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:1c:e6,bridge_name='br-int',has_traffic_filtering=True,id=9a6af2c1-2262-4553-bd47-ac5f57131fdc,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6af2c1-22') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG os_vif [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:1c:e6,bridge_name='br-int',has_traffic_filtering=True,id=9a6af2c1-2262-4553-bd47-ac5f57131fdc,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6af2c1-22') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a6af2c1-22, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a6af2c1-22, col_values=(('external_ids', {'iface-id': '9a6af2c1-2262-4553-bd47-ac5f57131fdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:1c:e6', 'vm-uuid': 'b148f5b5-ada4-49a6-9e9c-cd04283223ee'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:15 user nova-compute[73068]: INFO os_vif [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:1c:e6,bridge_name='br-int',has_traffic_filtering=True,id=9a6af2c1-2262-4553-bd47-ac5f57131fdc,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6af2c1-22')
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:57:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No VIF found with MAC fa:16:3e:1e:1c:e6, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:57:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-e85a7621-7b70-4549-9056-7108e975fb95 req-390b6921-159a-437f-aa91-bfb534bb1cf3 service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Updated VIF entry in instance network info cache for port 9a6af2c1-2262-4553-bd47-ac5f57131fdc. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:57:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-e85a7621-7b70-4549-9056-7108e975fb95 req-390b6921-159a-437f-aa91-bfb534bb1cf3 service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Updating instance_info_cache with network_info: [{"id": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "address": "fa:16:3e:1e:1c:e6", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6af2c1-22", "ovs_interfaceid": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:57:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e85a7621-7b70-4549-9056-7108e975fb95 req-390b6921-159a-437f-aa91-bfb534bb1cf3 service nova] Releasing lock "refresh_cache-b148f5b5-ada4-49a6-9e9c-cd04283223ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:57:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:57:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-f60e6102-4636-4a53-9254-1a77a363b2b7 req-bbcb4820-040f-41d3-84a6-1df3de983d7c service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Received event network-vif-plugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:57:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f60e6102-4636-4a53-9254-1a77a363b2b7 req-bbcb4820-040f-41d3-84a6-1df3de983d7c service nova] Acquiring lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f60e6102-4636-4a53-9254-1a77a363b2b7 req-bbcb4820-040f-41d3-84a6-1df3de983d7c service nova] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f60e6102-4636-4a53-9254-1a77a363b2b7 req-bbcb4820-040f-41d3-84a6-1df3de983d7c service nova] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-f60e6102-4636-4a53-9254-1a77a363b2b7 req-bbcb4820-040f-41d3-84a6-1df3de983d7c service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] No waiting events found dispatching network-vif-plugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:57:17 user nova-compute[73068]: WARNING nova.compute.manager [req-f60e6102-4636-4a53-9254-1a77a363b2b7 req-bbcb4820-040f-41d3-84a6-1df3de983d7c service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Received unexpected event network-vif-plugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc for instance with vm_state building and task_state spawning.
Aug 26 11:57:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051039.4452634, b148f5b5-ada4-49a6-9e9c-cd04283223ee => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:57:19 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] VM Resumed (Lifecycle Event)
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:57:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Instance spawned successfully.
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:57:19 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051039.4493387, b148f5b5-ada4-49a6-9e9c-cd04283223ee => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:57:19 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] VM Started (Lifecycle Event)
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:57:19 user nova-compute[73068]: INFO nova.compute.manager [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Took 6.75 seconds to spawn the instance on the hypervisor.
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:57:19 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-005a01eb-c97b-423f-a120-55459b1c31c1 req-0b0d07ee-85ae-4e2d-becb-089fe5398e23 service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Received event network-vif-plugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-005a01eb-c97b-423f-a120-55459b1c31c1 req-0b0d07ee-85ae-4e2d-becb-089fe5398e23 service nova] Acquiring lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-005a01eb-c97b-423f-a120-55459b1c31c1 req-0b0d07ee-85ae-4e2d-becb-089fe5398e23 service nova] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-005a01eb-c97b-423f-a120-55459b1c31c1 req-0b0d07ee-85ae-4e2d-becb-089fe5398e23 service nova] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-005a01eb-c97b-423f-a120-55459b1c31c1 req-0b0d07ee-85ae-4e2d-becb-089fe5398e23 service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] No waiting events found dispatching network-vif-plugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:57:19 user nova-compute[73068]: WARNING nova.compute.manager [req-005a01eb-c97b-423f-a120-55459b1c31c1 req-0b0d07ee-85ae-4e2d-becb-089fe5398e23 service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Received unexpected event network-vif-plugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc for instance with vm_state building and task_state spawning.
Aug 26 11:57:19 user nova-compute[73068]: INFO nova.compute.manager [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Took 7.44 seconds to build instance.
Aug 26 11:57:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-15aab917-ae6b-4a80-b57e-cca3a921ac9d tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.568s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'flavor' on Instance uuid bb9c655d-7e26-45bd-9e28-a695ca25a69b {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:23 user nova-compute[73068]: INFO nova.compute.manager [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Attaching volume 2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 to /dev/vdb
Aug 26 11:57:23 user nova-compute[73068]: DEBUG os_brick.utils [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd42872-d9f6-4bf6-95eb-4ac1d4e29076]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2f45b7-45bc-4f93-a2e2-62845bcfd474]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01fe364-a0cd-4469-90cd-1637f1a300ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bd526e-66ec-4b55-98db-316d88f255ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:57:23 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:57:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[248cc115-80bd-4c98-b44f-2f3efa336991]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG os_brick.utils [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:57:23 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updating existing volume attachment record: 4e0f47c2-999f-4f4a-b695-a1510ca2da68 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:57:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImnhBHXV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:57:35 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:57:35 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:57:35 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dcbb1f-cf08-445e-9f86-1837cf16271c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:57:35 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3742bdd3-b5a4-4572-9d44-bbd8271261b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028] added
Aug 26 11:57:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2569cb-795a-41fd-9bd5-512f498ced9e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[87005d65-0fb5-4581-a4e9-2148f095e967]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ImnhBHXV {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ImnhBHXV" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d93bc9-4769-46c3-b5e4-ca89018652ae]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ImnhBHXV'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f117eb3-abaa-4122-a34a-5c77c99b3433]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a74ab3a-30b6-499d-83be-40c5475ec4bf]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:57:35 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:57:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:57:35 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:57:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e909b0-d38d-4227-9d69-e92fd974d57f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028, portal: 172.16.0.220,3260]
Aug 26 11:57:35 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028, portal: 172.16.0.220,3260] successful.
Aug 26 11:57:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2f2ccd-944d-49d5-b91d-2af1bb7885d3]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbcbc67-038b-49e6-aa68-ceb2134965ca]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:57:35 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:57:35 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:57:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:57:35 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:57:35 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:57:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32ecdf-2cca-4ac7-b4cb-9d687cb8cb2c]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImnhBHXV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:57:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:57:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:57:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23135613539366566', 'path': '/dev/sdd'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:57:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135613539366566', 'path': '/dev/sdd'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:57:36 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'flavor' on Instance uuid bb9c655d-7e26-45bd-9e28-a695ca25a69b {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:57:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:57:36 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:57:36 user nova-compute[73068]:   <source dev="/dev/sdd"/>
Aug 26 11:57:36 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:57:36 user nova-compute[73068]:   <serial>2622b9d1-e7fd-4636-9f28-3c7c1d0ff028</serial>
Aug 26 11:57:36 user nova-compute[73068]: </disk>
Aug 26 11:57:36 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:57:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:57:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:57:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] No VIF found with MAC fa:16:3e:2f:a0:52, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:57:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b5a1c898-0de5-4e5a-aad0-e95c84e60dc5 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.388s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-2017e056-a743-4b1d-b490-b671c73e7895 req-ccf3a016-5d80-48e2-8771-c16ec4270aa1 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-changed-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:57:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-2017e056-a743-4b1d-b490-b671c73e7895 req-ccf3a016-5d80-48e2-8771-c16ec4270aa1 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Refreshing instance network info cache due to event network-changed-5e4a0bfe-be50-46d7-a4db-56790f1cb09c. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:57:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2017e056-a743-4b1d-b490-b671c73e7895 req-ccf3a016-5d80-48e2-8771-c16ec4270aa1 service nova] Acquiring lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:57:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2017e056-a743-4b1d-b490-b671c73e7895 req-ccf3a016-5d80-48e2-8771-c16ec4270aa1 service nova] Acquired lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:57:40 user nova-compute[73068]: DEBUG nova.network.neutron [req-2017e056-a743-4b1d-b490-b671c73e7895 req-ccf3a016-5d80-48e2-8771-c16ec4270aa1 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Refreshing network info cache for port 5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:57:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-2017e056-a743-4b1d-b490-b671c73e7895 req-ccf3a016-5d80-48e2-8771-c16ec4270aa1 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updated VIF entry in instance network info cache for port 5e4a0bfe-be50-46d7-a4db-56790f1cb09c. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:57:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-2017e056-a743-4b1d-b490-b671c73e7895 req-ccf3a016-5d80-48e2-8771-c16ec4270aa1 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updating instance_info_cache with network_info: [{"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:57:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2017e056-a743-4b1d-b490-b671c73e7895 req-ccf3a016-5d80-48e2-8771-c16ec4270aa1 service nova] Releasing lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:57:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-49cca890-2fc3-46c1-84b6-9131c6da2a07 req-42b6a5ff-2088-4c5a-836a-7d1b4226944e service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-changed-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:57:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-49cca890-2fc3-46c1-84b6-9131c6da2a07 req-42b6a5ff-2088-4c5a-836a-7d1b4226944e service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Refreshing instance network info cache due to event network-changed-5e4a0bfe-be50-46d7-a4db-56790f1cb09c. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:57:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-49cca890-2fc3-46c1-84b6-9131c6da2a07 req-42b6a5ff-2088-4c5a-836a-7d1b4226944e service nova] Acquiring lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:57:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-49cca890-2fc3-46c1-84b6-9131c6da2a07 req-42b6a5ff-2088-4c5a-836a-7d1b4226944e service nova] Acquired lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:57:42 user nova-compute[73068]: DEBUG nova.network.neutron [req-49cca890-2fc3-46c1-84b6-9131c6da2a07 req-42b6a5ff-2088-4c5a-836a-7d1b4226944e service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Refreshing network info cache for port 5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:57:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:43 user nova-compute[73068]: INFO nova.compute.manager [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Rebooting instance
Aug 26 11:57:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:57:43 user nova-compute[73068]: DEBUG nova.network.neutron [req-49cca890-2fc3-46c1-84b6-9131c6da2a07 req-42b6a5ff-2088-4c5a-836a-7d1b4226944e service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updated VIF entry in instance network info cache for port 5e4a0bfe-be50-46d7-a4db-56790f1cb09c. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:57:43 user nova-compute[73068]: DEBUG nova.network.neutron [req-49cca890-2fc3-46c1-84b6-9131c6da2a07 req-42b6a5ff-2088-4c5a-836a-7d1b4226944e service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updating instance_info_cache with network_info: [{"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:57:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-49cca890-2fc3-46c1-84b6-9131c6da2a07 req-42b6a5ff-2088-4c5a-836a-7d1b4226944e service nova] Releasing lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:57:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquired lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:57:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:57:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updating instance_info_cache with network_info: [{"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:57:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Releasing lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:57:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:57:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-1773e859-3335-4eb6-95d3-3f8e1632b4e5 req-1075c121-d352-464b-b189-d2eaf6b6eb1f service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-vif-unplugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:57:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1773e859-3335-4eb6-95d3-3f8e1632b4e5 req-1075c121-d352-464b-b189-d2eaf6b6eb1f service nova] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1773e859-3335-4eb6-95d3-3f8e1632b4e5 req-1075c121-d352-464b-b189-d2eaf6b6eb1f service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1773e859-3335-4eb6-95d3-3f8e1632b4e5 req-1075c121-d352-464b-b189-d2eaf6b6eb1f service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-1773e859-3335-4eb6-95d3-3f8e1632b4e5 req-1075c121-d352-464b-b189-d2eaf6b6eb1f service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] No waiting events found dispatching network-vif-unplugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:57:47 user nova-compute[73068]: WARNING nova.compute.manager [req-1773e859-3335-4eb6-95d3-3f8e1632b4e5 req-1075c121-d352-464b-b189-d2eaf6b6eb1f service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received unexpected event network-vif-unplugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c for instance with vm_state active and task_state reboot_started.
Aug 26 11:57:47 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Instance shutdown successfully.
Aug 26 11:57:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:49 user nova-compute[73068]: DEBUG nova.compute.manager [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:57:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:49 user nova-compute[73068]: DEBUG nova.compute.manager [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] No waiting events found dispatching network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:57:49 user nova-compute[73068]: WARNING nova.compute.manager [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received unexpected event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c for instance with vm_state active and task_state reboot_started.
Aug 26 11:57:49 user nova-compute[73068]: DEBUG nova.compute.manager [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:57:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:49 user nova-compute[73068]: DEBUG nova.compute.manager [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] No waiting events found dispatching network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:57:49 user nova-compute[73068]: WARNING nova.compute.manager [req-7c96ac52-fa9e-461a-af18-2e3416b6ed57 req-f06c8696-ccf3-49cd-8bec-3447e715bc92 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received unexpected event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c for instance with vm_state active and task_state reboot_started.
Aug 26 11:57:49 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:49 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:49 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for bb9c655d-7e26-45bd-9e28-a695ca25a69b due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 11:57:50 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051070.6900988, bb9c655d-7e26-45bd-9e28-a695ca25a69b => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:57:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] VM Resumed (Lifecycle Event)
Aug 26 11:57:50 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Instance running successfully.
Aug 26 11:57:50 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Instance soft rebooted successfully.
Aug 26 11:57:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:57:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:57:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:57:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 26 11:57:50 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051070.6958838, bb9c655d-7e26-45bd-9e28-a695ca25a69b => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:57:50 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] VM Started (Lifecycle Event)
Aug 26 11:57:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62faec26-87ac-4da1-828e-69c27f66b286 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.650s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:57:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:57:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-9579070c-c676-408f-87b4-df577d2e6a8c req-400ab4c0-5cca-428e-8469-8e5899035a25 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:57:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9579070c-c676-408f-87b4-df577d2e6a8c req-400ab4c0-5cca-428e-8469-8e5899035a25 service nova] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:57:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9579070c-c676-408f-87b4-df577d2e6a8c req-400ab4c0-5cca-428e-8469-8e5899035a25 service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:57:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9579070c-c676-408f-87b4-df577d2e6a8c req-400ab4c0-5cca-428e-8469-8e5899035a25 service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:57:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-9579070c-c676-408f-87b4-df577d2e6a8c req-400ab4c0-5cca-428e-8469-8e5899035a25 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] No waiting events found dispatching network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:57:51 user nova-compute[73068]: WARNING nova.compute.manager [req-9579070c-c676-408f-87b4-df577d2e6a8c req-400ab4c0-5cca-428e-8469-8e5899035a25 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received unexpected event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c for instance with vm_state active and task_state None.
Aug 26 11:57:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:57:59 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:02 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:58:05 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:05 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:05 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:58:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 11:58:07 user nova-compute[73068]: INFO nova.compute.claims [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Claim successful on node user
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.736s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 11:58:07 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 11:58:07 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 11:58:07 user nova-compute[73068]: INFO nova.virt.block_device [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Booting with volume 24605550-f83a-422e-98d1-831df5da04a3 at /dev/vda
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.policy [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ee37cf249774afdad5850676ccae88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4d268fa0703413ca9f163a0891bc202', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG os_brick.utils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4326bf-6588-401b-8e95-486ba51ddb9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5be81c-e15e-4d29-bf50-da74a00266f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:08 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:58:08 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7771MB free_disk=25.117786407470703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cff22e-06ef-411f-b565-79cab0d06b50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ad5a36-448a-432a-9ae9-e0c9460f9a60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:58:08 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ef3f9-0f95-49bb-bd8b-a8856cc8e034]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG os_brick.utils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] <== get_connector_properties: return (535ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating existing volume attachment record: 5e8d1370-c33c-4e6b-b955-dad9795ec2c5 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Applying migration context for instance 1af1b911-507d-4303-bf15-b0ebc8b86665 as it has an incoming, in-progress migration 8db63efd-8aff-4e3f-acb1-f6db004dda57. Migration status is finished {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 11:58:08 user nova-compute[73068]: INFO nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating resource usage from migration 8db63efd-8aff-4e3f-acb1-f6db004dda57
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance bb9c655d-7e26-45bd-9e28-a695ca25a69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance d74da117-dc27-46b4-897b-763ef5137a6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Migration 8db63efd-8aff-4e3f-acb1-f6db004dda57 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 1af1b911-507d-4303-bf15-b0ebc8b86665 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance f024a327-fe6d-4599-9d04-94f7dc54e646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance b148f5b5-ada4-49a6-9e9c-cd04283223ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 88e1f171-b5e8-4164-a659-69f8fdc653ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 11:58:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:09 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Successfully created port: fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 11:58:09 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Successfully updated port: fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 11:58:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:58:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquired lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:58:09 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-e42b9efa-2253-4a0b-8bef-d0cbf0c29ef7 req-5aba9f79-139a-4522-bc49-1f94d9ffb8c6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-changed-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-e42b9efa-2253-4a0b-8bef-d0cbf0c29ef7 req-5aba9f79-139a-4522-bc49-1f94d9ffb8c6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Refreshing instance network info cache due to event network-changed-fd463838-cf9f-4607-a540-856cf74753d9. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e42b9efa-2253-4a0b-8bef-d0cbf0c29ef7 req-5aba9f79-139a-4522-bc49-1f94d9ffb8c6 service nova] Acquiring lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG nova.network.neutron [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating instance_info_cache with network_info: [{"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Releasing lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Instance network_info: |[{"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e42b9efa-2253-4a0b-8bef-d0cbf0c29ef7 req-5aba9f79-139a-4522-bc49-1f94d9ffb8c6 service nova] Acquired lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG nova.network.neutron [req-e42b9efa-2253-4a0b-8bef-d0cbf0c29ef7 req-5aba9f79-139a-4522-bc49-1f94d9ffb8c6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Refreshing network info cache for port fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG nova.network.neutron [req-e42b9efa-2253-4a0b-8bef-d0cbf0c29ef7 req-5aba9f79-139a-4522-bc49-1f94d9ffb8c6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updated VIF entry in instance network info cache for port fd463838-cf9f-4607-a540-856cf74753d9. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG nova.network.neutron [req-e42b9efa-2253-4a0b-8bef-d0cbf0c29ef7 req-5aba9f79-139a-4522-bc49-1f94d9ffb8c6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating instance_info_cache with network_info: [{"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e42b9efa-2253-4a0b-8bef-d0cbf0c29ef7 req-5aba9f79-139a-4522-bc49-1f94d9ffb8c6 service nova] Releasing lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:58:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:58:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:58:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:58:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updating instance_info_cache with network_info: [{"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:58:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:58:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:58:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-c42d4854-6bdb-4502-8e86-2eba449505a7 req-9de0515e-cda6-4d04-819c-63dc860a972a service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-changed-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:58:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-c42d4854-6bdb-4502-8e86-2eba449505a7 req-9de0515e-cda6-4d04-819c-63dc860a972a service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Refreshing instance network info cache due to event network-changed-45871af6-d08f-40df-bc66-24eae82b28fc. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:58:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c42d4854-6bdb-4502-8e86-2eba449505a7 req-9de0515e-cda6-4d04-819c-63dc860a972a service nova] Acquiring lock "refresh_cache-d74da117-dc27-46b4-897b-763ef5137a6e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:58:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c42d4854-6bdb-4502-8e86-2eba449505a7 req-9de0515e-cda6-4d04-819c-63dc860a972a service nova] Acquired lock "refresh_cache-d74da117-dc27-46b4-897b-763ef5137a6e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:58:15 user nova-compute[73068]: DEBUG nova.network.neutron [req-c42d4854-6bdb-4502-8e86-2eba449505a7 req-9de0515e-cda6-4d04-819c-63dc860a972a service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Refreshing network info cache for port 45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:58:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-c42d4854-6bdb-4502-8e86-2eba449505a7 req-9de0515e-cda6-4d04-819c-63dc860a972a service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Updated VIF entry in instance network info cache for port 45871af6-d08f-40df-bc66-24eae82b28fc. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:58:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-c42d4854-6bdb-4502-8e86-2eba449505a7 req-9de0515e-cda6-4d04-819c-63dc860a972a service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Updating instance_info_cache with network_info: [{"id": "45871af6-d08f-40df-bc66-24eae82b28fc", "address": "fa:16:3e:cc:9c:22", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45871af6-d0", "ovs_interfaceid": "45871af6-d08f-40df-bc66-24eae82b28fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:58:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c42d4854-6bdb-4502-8e86-2eba449505a7 req-9de0515e-cda6-4d04-819c-63dc860a972a service nova] Releasing lock "refresh_cache-d74da117-dc27-46b4-897b-763ef5137a6e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:58:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Going to confirm migration 1 {{(pid=73068) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 26 11:58:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:58:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquired lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:58:17 user nova-compute[73068]: DEBUG nova.network.neutron [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 11:58:17 user nova-compute[73068]: DEBUG nova.objects.instance [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'info_cache' on Instance uuid 1af1b911-507d-4303-bf15-b0ebc8b86665 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG nova.network.neutron [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating instance_info_cache with network_info: [{"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Releasing lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG nova.objects.instance [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'migration_context' on Instance uuid 1af1b911-507d-4303-bf15-b0ebc8b86665 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG nova.objects.base [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Object Instance<1af1b911-507d-4303-bf15-b0ebc8b86665> lazy-loaded attributes: info_cache,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:58:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.399s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:18 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Deleted allocation for migration 8db63efd-8aff-4e3f-acb1-f6db004dda57
Aug 26 11:58:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-04cd559e-5638-4e82-8814-5ff9782b26b8 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.409s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 11:58:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Creating image(s)
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Ensure instance console log exists: /opt/stack/data/nova/instances/88e1f171-b5e8-4164-a659-69f8fdc653ed/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Start _get_guest_xml network_info=[{"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '5e8d1370-c33c-4e6b-b955-dad9795ec2c5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Qmktbyxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88e1f171-b5e8-4164-a659-69f8fdc653ed', 'attached_at': '', 'detached_at': '', 'volume_id': '24605550-f83a-422e-98d1-831df5da04a3', 'serial': '24605550-f83a-422e-98d1-831df5da04a3'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 11:58:19 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:58:19 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 11:58:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Qmktbyxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:20 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:20 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:20 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc42d6b-8e52-4fef-b6f5-202a8f9d2d8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:58:20 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7347cefc-326c-422b-8613-3b7319d1fc5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3] added
Aug 26 11:58:20 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f0e9ab-495d-4893-a66a-5e423ccd6c6b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c234c408-9750-4bd4-a648-c55e22d0ec94]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Qmktbyxa {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Qmktbyxa" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bc43ef-e179-4028-b8e5-9fbc6b7a4d4e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Qmktbyxa'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[176d2230-0a53-4389-839f-7a0553a0fe5f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ace23d-6df2-4cb8-ae03-399cec99b224]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:20 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:20 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:20 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:20 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:20 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:20 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbef69fc-e4bb-458c-867c-14bba54eb6fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260]
Aug 26 11:58:20 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260] successful.
Aug 26 11:58:20 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[660c11c8-76d5-4f35-9626-4e274713d20b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bf1d98-0bc5-4aff-84dc-16659ce1f37e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:20 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:20 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:20 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:20 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:20 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:20 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:20 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:20 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[be600705-8579-411e-ad8a-edac1b4dd051]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG nova.objects.instance [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid d74da117-dc27-46b4-897b-763ef5137a6e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.197s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:20 user nova-compute[73068]: INFO nova.compute.manager [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Attaching volume c899aa11-268a-486d-8f68-c2895c92d195 to /dev/vdb
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.utils [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd34f4e1-cc0d-44a3-97e4-8f2b733b7f87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12fe47a-7796-4279-b5c6-7af7b6e1a3b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dcd708-f9b1-4ef4-931f-142e8f562a1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7725aaf0-13dd-4bfb-99ec-b2dbfe5e17c9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:58:20 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:58:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[797428ff-ab66-42d8-be0c-bc72a23457fa]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG os_brick.utils [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:58:20 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Updating existing volume attachment record: 5cadbd11-1525-4eec-82bc-aad6d15db534 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Qmktbyxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23864393664666162', 'path': '/dev/sde'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864393664666162', 'path': '/dev/sde'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1280182601',display_name='tempest-TestShelveInstance-server-1280182601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1280182601',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGL8Ha7TtzLXzshoSYdSUgbeLXe4Fjn3BpBi7Ymb/G4hsJYJn7NLJ42fo8AhnamN8TZF6r1Zn9z8XzPVcto8SGXZ7Rl9pONBpfaOg3kTKzx2H0ctmX5UTLNwyl9q0NLLQ==',key_name='tempest-TestShelveInstance-2008128873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4d268fa0703413ca9f163a0891bc202',ramdisk_id='',reservation_id='r-80efw2yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1913379620',owner_user_name='tempest-TestShelveInstance-1913379620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:58:08Z,user_data=None,user_id='7ee37cf249774afdad5850676ccae88f',uuid=88e1f171-b5e8-4164-a659-69f8fdc653ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converting VIF {"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG nova.objects.instance [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lazy-loading 'pci_devices' on Instance uuid 88e1f171-b5e8-4164-a659-69f8fdc653ed {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] End _get_guest_xml xml=<domain type="kvm">
Aug 26 11:58:21 user nova-compute[73068]:   <uuid>88e1f171-b5e8-4164-a659-69f8fdc653ed</uuid>
Aug 26 11:58:21 user nova-compute[73068]:   <name>instance-00000028</name>
Aug 26 11:58:21 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 11:58:21 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 11:58:21 user nova-compute[73068]:   <metadata>
Aug 26 11:58:21 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 11:58:21 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 11:58:21 user nova-compute[73068]:       <nova:name>tempest-TestShelveInstance-server-1280182601</nova:name>
Aug 26 11:58:21 user nova-compute[73068]:       <nova:creationTime>2023-08-26 11:58:19</nova:creationTime>
Aug 26 11:58:21 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 11:58:21 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 11:58:21 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 11:58:21 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 11:58:21 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 11:58:21 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 11:58:21 user nova-compute[73068]:       </nova:flavor>
Aug 26 11:58:21 user nova-compute[73068]:       <nova:owner>
Aug 26 11:58:21 user nova-compute[73068]:         <nova:user uuid="7ee37cf249774afdad5850676ccae88f">tempest-TestShelveInstance-1913379620-project-member</nova:user>
Aug 26 11:58:21 user nova-compute[73068]:         <nova:project uuid="c4d268fa0703413ca9f163a0891bc202">tempest-TestShelveInstance-1913379620</nova:project>
Aug 26 11:58:21 user nova-compute[73068]:       </nova:owner>
Aug 26 11:58:21 user nova-compute[73068]:       <nova:ports>
Aug 26 11:58:21 user nova-compute[73068]:         <nova:port uuid="fd463838-cf9f-4607-a540-856cf74753d9">
Aug 26 11:58:21 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 11:58:21 user nova-compute[73068]:         </nova:port>
Aug 26 11:58:21 user nova-compute[73068]:       </nova:ports>
Aug 26 11:58:21 user nova-compute[73068]:     </nova:instance>
Aug 26 11:58:21 user nova-compute[73068]:   </metadata>
Aug 26 11:58:21 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 11:58:21 user nova-compute[73068]:     <system>
Aug 26 11:58:21 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 11:58:21 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 11:58:21 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 11:58:21 user nova-compute[73068]:       <entry name="serial">88e1f171-b5e8-4164-a659-69f8fdc653ed</entry>
Aug 26 11:58:21 user nova-compute[73068]:       <entry name="uuid">88e1f171-b5e8-4164-a659-69f8fdc653ed</entry>
Aug 26 11:58:21 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 11:58:21 user nova-compute[73068]:     </system>
Aug 26 11:58:21 user nova-compute[73068]:   </sysinfo>
Aug 26 11:58:21 user nova-compute[73068]:   <os>
Aug 26 11:58:21 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 11:58:21 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 11:58:21 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 11:58:21 user nova-compute[73068]:   </os>
Aug 26 11:58:21 user nova-compute[73068]:   <features>
Aug 26 11:58:21 user nova-compute[73068]:     <acpi/>
Aug 26 11:58:21 user nova-compute[73068]:     <apic/>
Aug 26 11:58:21 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 11:58:21 user nova-compute[73068]:   </features>
Aug 26 11:58:21 user nova-compute[73068]:   <clock offset="utc">
Aug 26 11:58:21 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 11:58:21 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 11:58:21 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 11:58:21 user nova-compute[73068]:   </clock>
Aug 26 11:58:21 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 11:58:21 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 11:58:21 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 11:58:21 user nova-compute[73068]:   </cpu>
Aug 26 11:58:21 user nova-compute[73068]:   <devices>
Aug 26 11:58:21 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 11:58:21 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:58:21 user nova-compute[73068]:       <source dev="/dev/sde"/>
Aug 26 11:58:21 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 11:58:21 user nova-compute[73068]:       <serial>24605550-f83a-422e-98d1-831df5da04a3</serial>
Aug 26 11:58:21 user nova-compute[73068]:     </disk>
Aug 26 11:58:21 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 11:58:21 user nova-compute[73068]:       <mac address="fa:16:3e:dd:90:d8"/>
Aug 26 11:58:21 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:58:21 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 11:58:21 user nova-compute[73068]:       <target dev="tapfd463838-cf"/>
Aug 26 11:58:21 user nova-compute[73068]:     </interface>
Aug 26 11:58:21 user nova-compute[73068]:     <serial type="pty">
Aug 26 11:58:21 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/88e1f171-b5e8-4164-a659-69f8fdc653ed/console.log" append="off"/>
Aug 26 11:58:21 user nova-compute[73068]:     </serial>
Aug 26 11:58:21 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 11:58:21 user nova-compute[73068]:     <video>
Aug 26 11:58:21 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 11:58:21 user nova-compute[73068]:     </video>
Aug 26 11:58:21 user nova-compute[73068]:     <rng model="virtio">
Aug 26 11:58:21 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 11:58:21 user nova-compute[73068]:     </rng>
Aug 26 11:58:21 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 11:58:21 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 11:58:21 user nova-compute[73068]:       <stats period="10"/>
Aug 26 11:58:21 user nova-compute[73068]:     </memballoon>
Aug 26 11:58:21 user nova-compute[73068]:   </devices>
Aug 26 11:58:21 user nova-compute[73068]: </domain>
Aug 26 11:58:21 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1280182601',display_name='tempest-TestShelveInstance-server-1280182601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1280182601',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGL8Ha7TtzLXzshoSYdSUgbeLXe4Fjn3BpBi7Ymb/G4hsJYJn7NLJ42fo8AhnamN8TZF6r1Zn9z8XzPVcto8SGXZ7Rl9pONBpfaOg3kTKzx2H0ctmX5UTLNwyl9q0NLLQ==',key_name='tempest-TestShelveInstance-2008128873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4d268fa0703413ca9f163a0891bc202',ramdisk_id='',reservation_id='r-80efw2yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1913379620',owner_user_name='tempest-TestShelveInstance-1913379620-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T11:58:08Z,user_data=None,user_id='7ee37cf249774afdad5850676ccae88f',uuid=88e1f171-b5e8-4164-a659-69f8fdc653ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converting VIF {"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG os_vif [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd463838-cf, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd463838-cf, col_values=(('external_ids', {'iface-id': 'fd463838-cf9f-4607-a540-856cf74753d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:90:d8', 'vm-uuid': '88e1f171-b5e8-4164-a659-69f8fdc653ed'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:21 user nova-compute[73068]: INFO os_vif [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf')
Aug 26 11:58:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:58:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] No VIF found with MAC fa:16:3e:dd:90:d8, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:58:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-f48d0267-cc39-41ae-a89a-cb2210d70844 req-f23cd21b-bd3c-48e3-bfc7-2424ab664a83 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:58:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f48d0267-cc39-41ae-a89a-cb2210d70844 req-f23cd21b-bd3c-48e3-bfc7-2424ab664a83 service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f48d0267-cc39-41ae-a89a-cb2210d70844 req-f23cd21b-bd3c-48e3-bfc7-2424ab664a83 service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f48d0267-cc39-41ae-a89a-cb2210d70844 req-f23cd21b-bd3c-48e3-bfc7-2424ab664a83 service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-f48d0267-cc39-41ae-a89a-cb2210d70844 req-f23cd21b-bd3c-48e3-bfc7-2424ab664a83 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:58:22 user nova-compute[73068]: WARNING nova.compute.manager [req-f48d0267-cc39-41ae-a89a-cb2210d70844 req-f23cd21b-bd3c-48e3-bfc7-2424ab664a83 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received unexpected event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with vm_state building and task_state spawning.
Aug 26 11:58:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051104.8047101, 88e1f171-b5e8-4164-a659-69f8fdc653ed => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:58:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] VM Resumed (Lifecycle Event)
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 11:58:24 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Instance spawned successfully.
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 11:58:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051104.8062959, 88e1f171-b5e8-4164-a659-69f8fdc653ed => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:58:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] VM Started (Lifecycle Event)
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 11:58:24 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 11:58:24 user nova-compute[73068]: INFO nova.compute.manager [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Took 4.95 seconds to spawn the instance on the hypervisor.
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-bc054684-11c8-4a6b-be39-8c2189305261 req-cdd624c5-fb40-4222-a8a7-154aed5287e0 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bc054684-11c8-4a6b-be39-8c2189305261 req-cdd624c5-fb40-4222-a8a7-154aed5287e0 service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bc054684-11c8-4a6b-be39-8c2189305261 req-cdd624c5-fb40-4222-a8a7-154aed5287e0 service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bc054684-11c8-4a6b-be39-8c2189305261 req-cdd624c5-fb40-4222-a8a7-154aed5287e0 service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-bc054684-11c8-4a6b-be39-8c2189305261 req-cdd624c5-fb40-4222-a8a7-154aed5287e0 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:58:24 user nova-compute[73068]: WARNING nova.compute.manager [req-bc054684-11c8-4a6b-be39-8c2189305261 req-cdd624c5-fb40-4222-a8a7-154aed5287e0 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received unexpected event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with vm_state building and task_state spawning.
Aug 26 11:58:24 user nova-compute[73068]: INFO nova.compute.manager [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Took 18.07 seconds to build instance.
Aug 26 11:58:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f2dc8ac-b1b2-4bec-8426-b48c70e52a5f tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.212s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-e4fd0ac1-6498-42dd-96c5-b2a30b5f3765 req-a9466540-f97a-49b7-a320-2dc4d4fe86a3 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Received event network-changed-19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:58:27 user nova-compute[73068]: DEBUG nova.compute.manager [req-e4fd0ac1-6498-42dd-96c5-b2a30b5f3765 req-a9466540-f97a-49b7-a320-2dc4d4fe86a3 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Refreshing instance network info cache due to event network-changed-19513704-e0e6-4e4b-92b4-354893c9fa27. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:58:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e4fd0ac1-6498-42dd-96c5-b2a30b5f3765 req-a9466540-f97a-49b7-a320-2dc4d4fe86a3 service nova] Acquiring lock "refresh_cache-f024a327-fe6d-4599-9d04-94f7dc54e646" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:58:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e4fd0ac1-6498-42dd-96c5-b2a30b5f3765 req-a9466540-f97a-49b7-a320-2dc4d4fe86a3 service nova] Acquired lock "refresh_cache-f024a327-fe6d-4599-9d04-94f7dc54e646" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:58:27 user nova-compute[73068]: DEBUG nova.network.neutron [req-e4fd0ac1-6498-42dd-96c5-b2a30b5f3765 req-a9466540-f97a-49b7-a320-2dc4d4fe86a3 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Refreshing network info cache for port 19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-e4fd0ac1-6498-42dd-96c5-b2a30b5f3765 req-a9466540-f97a-49b7-a320-2dc4d4fe86a3 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Updated VIF entry in instance network info cache for port 19513704-e0e6-4e4b-92b4-354893c9fa27. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-e4fd0ac1-6498-42dd-96c5-b2a30b5f3765 req-a9466540-f97a-49b7-a320-2dc4d4fe86a3 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Updating instance_info_cache with network_info: [{"id": "19513704-e0e6-4e4b-92b4-354893c9fa27", "address": "fa:16:3e:a6:4b:b1", "network": {"id": "983a876f-5f9d-4528-aed3-d3d03297deb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518423548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acb7739d15924faba2b87a6929e91009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19513704-e0", "ovs_interfaceid": "19513704-e0e6-4e4b-92b4-354893c9fa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e4fd0ac1-6498-42dd-96c5-b2a30b5f3765 req-a9466540-f97a-49b7-a320-2dc4d4fe86a3 service nova] Releasing lock "refresh_cache-f024a327-fe6d-4599-9d04-94f7dc54e646" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG nova.objects.instance [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lazy-loading 'flavor' on Instance uuid f024a327-fe6d-4599-9d04-94f7dc54e646 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.197s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:28 user nova-compute[73068]: INFO nova.compute.manager [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Attaching volume 116b403b-90f4-470c-b001-0afad386d205 to /dev/vdb
Aug 26 11:58:28 user nova-compute[73068]: DEBUG os_brick.utils [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee11165-5a92-43be-a0db-30a306b8beaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb2c06f-3c14-471e-ac30-368ea402e34f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b70ac4-f836-472b-96db-8431690a35a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba45b97-2dd4-4f43-8962-6de9c1269e87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:58:28 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:58:28 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[477ed299-324d-438d-be83-026401139266]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG os_brick.utils [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:58:28 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Updating existing volume attachment record: 6eb59075-1954-4161-8a53-424bb54403b2 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:58:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmQbfxEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:32 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:32 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:32 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[110e6481-b803-4296-b290-cf3fa1f6bc62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:58:32 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90c2e4c-fe6e-4b52-93a6-a86d47fde591]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195] added
Aug 26 11:58:32 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00bda25-eef2-4b9d-a712-1e94f3494a68]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[934c1520-47e3-4b50-be78-6c20956ba318]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmQbfxEL {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NmQbfxEL" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[66878350-8a7a-497a-8d14-1ee453e4e5d1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NmQbfxEL'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7edb493-7330-4793-a3b5-cd3fb1e6ada7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[593f8674-e4a1-4c4f-8ec2-8ef32919d042]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db9cdf6-4eff-43f9-9bfb-88a499ef0ebd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195, portal: 172.16.0.220,3260]
Aug 26 11:58:32 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195, portal: 172.16.0.220,3260] successful.
Aug 26 11:58:32 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[95878d24-a06d-4ab3-84ed-cb08a358fc2a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[af65a3dc-f57e-4154-a9d3-eaefc20c2701]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:32 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fa5ac7-cf53-4a51-8faf-32c477e58c36]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:58:32 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmQbfxEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:58:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:58:33 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26231626133336135', 'path': '/dev/sdf'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:58:33 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231626133336135', 'path': '/dev/sdf'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:58:33 user nova-compute[73068]: DEBUG nova.objects.instance [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid d74da117-dc27-46b4-897b-763ef5137a6e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:33 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:58:33 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:58:33 user nova-compute[73068]:   <source dev="/dev/sdf"/>
Aug 26 11:58:33 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:58:33 user nova-compute[73068]:   <serial>c899aa11-268a-486d-8f68-c2895c92d195</serial>
Aug 26 11:58:33 user nova-compute[73068]: </disk>
Aug 26 11:58:33 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:58:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:58:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:58:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No VIF found with MAC fa:16:3e:cc:9c:22, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:58:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-16e7d32f-49fb-4870-9b67-8124f3268bb0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.868s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG nova.objects.instance [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid d74da117-dc27-46b4-897b-763ef5137a6e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:39 user nova-compute[73068]: INFO nova.compute.manager [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Attaching volume c1149199-a249-4775-a120-2763b833778e to /dev/vdc
Aug 26 11:58:39 user nova-compute[73068]: DEBUG os_brick.utils [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[734c0c68-0c1f-4b39-b17f-9b41989b0b10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[af326059-216b-410a-aa95-59b07cecb296]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c2e3d8-a0cb-4480-b3c2-916b338a2bab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[af18bc52-3a2b-415a-acb9-f2388317d8ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:58:39 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:58:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06012c8-f8dc-4d85-94e8-6089410adf6d]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG os_brick.utils [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:58:39 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Updating existing volume attachment record: 60defe3d-b761-449a-a35b-7a6e2cd7c292 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUVChOEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:40 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:40 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:40 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[791d12a1-bb96-4f18-88b2-512977e8bfc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:58:40 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[064dd76b-0db6-4426-a5a9-a13b6aa0f7ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205] added
Aug 26 11:58:40 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d469cc-4c6d-4af8-84af-dbdf85dbb8af]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8384208-29f3-43d8-978b-2104a6151d2e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUVChOEb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BUVChOEb" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7973af87-403d-4a87-a3e9-2098d107d458]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BUVChOEb'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c04351-28ad-414b-95f3-38ec44cdb0a1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee18fff-7de2-47fa-90b7-d8ff9e990470]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:40 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:40 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:40 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:40 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:40 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:40 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:40 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:40 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:40 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:40 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:40 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[08662da9-7f40-4ede-8157-20608bf188ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205, portal: 172.16.0.220,3260]
Aug 26 11:58:41 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205, portal: 172.16.0.220,3260] successful.
Aug 26 11:58:41 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe480897-d885-48ad-94e6-d3fec4cde870]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3fb025-16d2-4240-b0b5-255389f24af4]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:41 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:41 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:41 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:41 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:41 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:41 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:41 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:41 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:41 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:41 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:41 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:41 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] HCTL ('38', '-', '-', 0) found on session 42 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c2d354-ecbc-4658-830c-0cfe0d4c4dc1]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUVChOEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:58:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:58:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23563616334653434', 'path': '/dev/sdg'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:58:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563616334653434', 'path': '/dev/sdg'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:58:42 user nova-compute[73068]: DEBUG nova.objects.instance [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lazy-loading 'flavor' on Instance uuid f024a327-fe6d-4599-9d04-94f7dc54e646 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:58:42 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:58:42 user nova-compute[73068]:   <source dev="/dev/sdg"/>
Aug 26 11:58:42 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:58:42 user nova-compute[73068]:   <serial>116b403b-90f4-470c-b001-0afad386d205</serial>
Aug 26 11:58:42 user nova-compute[73068]: </disk>
Aug 26 11:58:42 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:58:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:58:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:58:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] No VIF found with MAC fa:16:3e:a6:4b:b1, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:58:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-dd5f1e55-3072-4d06-92be-5617f8e48607 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.948s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lazy-loading 'flavor' on Instance uuid f024a327-fe6d-4599-9d04-94f7dc54e646 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:46 user nova-compute[73068]: INFO nova.compute.manager [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Attaching volume fc05d860-b5aa-46e6-808e-5e894bf32e47 to /dev/vdc
Aug 26 11:58:46 user nova-compute[73068]: DEBUG os_brick.utils [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95dff29-39f7-404b-ab2c-6edc42b16cf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba83f1a3-5a1c-44e3-be4b-4e5694d709dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ddcc04-df3e-41d7-8295-6ee0e0dd3577]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8035ec-0f7d-4d28-a42c-1b9d0229e01c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 11:58:46 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 11:58:46 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6205bf4-2919-4be1-b832-20eec46c1af0]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG os_brick.utils [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:58:46 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Updating existing volume attachment record: a70f6d2d-4467-4f36-ad1d-1d3ca072907e {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrJztWQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:51 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:51 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:51 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0d18c3-4c4b-4c0c-997d-8ffc41676dac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:58:51 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c41124f-7eb2-40f1-b7aa-ea5ea98f9879]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e] added
Aug 26 11:58:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe1317c-5f0b-411d-b909-3fdcf28caae9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[06609af8-63e1-4746-908d-f051f9fe5e6e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrJztWQl {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrJztWQl" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d461db-ec52-427a-aa20-a4664272c556]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XrJztWQl'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa13344e-e891-4bfa-8d18-cdcb27fe93ee]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ffdba8-17b7-4074-a4d2-9a70fe85589a]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[271c49b9-65b7-4414-a618-48cf9a8cb456]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e, portal: 172.16.0.220,3260]
Aug 26 11:58:51 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e, portal: 172.16.0.220,3260] successful.
Aug 26 11:58:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e47d101-bb02-4dce-b356-6a2bb5cec075]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f17377-5c08-4ffa-8d3b-33eec3795d7e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e (non-flash)
Aug 26 11:58:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:51 user nova-compute[73068]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e (non-flash)
Aug 26 11:58:51 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] HCTL ('39', '-', '-', 0) found on session 43 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd869ad8-56e9-42bb-add3-a74d60204bd5]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:51 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching for a device in session 43 and hctl ['39', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:58:52 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Searching for a device in session 43 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:58:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrJztWQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:58:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:58:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23030646462376536', 'path': '/dev/sdh'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:58:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030646462376536', 'path': '/dev/sdh'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:58:52 user nova-compute[73068]: DEBUG nova.objects.instance [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid d74da117-dc27-46b4-897b-763ef5137a6e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:58:52 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:58:52 user nova-compute[73068]:   <source dev="/dev/sdh"/>
Aug 26 11:58:52 user nova-compute[73068]:   <target dev="vdc" bus="virtio"/>
Aug 26 11:58:52 user nova-compute[73068]:   <serial>c1149199-a249-4775-a120-2763b833778e</serial>
Aug 26 11:58:52 user nova-compute[73068]: </disk>
Aug 26 11:58:52 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:58:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:58:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:58:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:58:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] No VIF found with MAC fa:16:3e:cc:9c:22, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:58:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-45f01095-47fb-4d78-b73d-5291778f41fb tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.987s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:54 user nova-compute[73068]: INFO nova.compute.manager [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Detaching volume c899aa11-268a-486d-8f68-c2895c92d195
Aug 26 11:58:54 user nova-compute[73068]: INFO nova.virt.block_device [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Attempting to driver detach volume c899aa11-268a-486d-8f68-c2895c92d195 from mountpoint /dev/vdb
Aug 26 11:58:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Attempting to detach device vdb from instance d74da117-dc27-46b4-897b-763ef5137a6e from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:58:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:58:54 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:58:54 user nova-compute[73068]:   <source dev="/dev/sdf"/>
Aug 26 11:58:54 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:58:54 user nova-compute[73068]:   <serial>c899aa11-268a-486d-8f68-c2895c92d195</serial>
Aug 26 11:58:54 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:58:54 user nova-compute[73068]: </disk>
Aug 26 11:58:54 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:58:54 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully detached device vdb from instance d74da117-dc27-46b4-897b-763ef5137a6e from the persistent domain config.
Aug 26 11:58:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d74da117-dc27-46b4-897b-763ef5137a6e from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:58:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:58:54 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:58:54 user nova-compute[73068]:   <source dev="/dev/sdf"/>
Aug 26 11:58:54 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:58:54 user nova-compute[73068]:   <serial>c899aa11-268a-486d-8f68-c2895c92d195</serial>
Aug 26 11:58:54 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:58:54 user nova-compute[73068]: </disk>
Aug 26 11:58:54 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693051135.4092407, d74da117-dc27-46b4-897b-763ef5137a6e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d74da117-dc27-46b4-897b-763ef5137a6e {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:58:55 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully detached device vdb from instance d74da117-dc27-46b4-897b-763ef5137a6e from the live domain config.
Aug 26 11:58:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NmQbfxEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:55 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e37324f-15d2-4c76-bfc2-b80ab0746345]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff9af75-8598-4f58-9dd6-56f50a655b26]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e (non-flash)
Aug 26 11:58:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:55 user nova-compute[73068]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e (non-flash)
Aug 26 11:58:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddbf8fa8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195'): ({'sdf'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Removing single pathed devices sdf {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e4dd06-26f0-4085-86c1-c994189d32ad]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a657eb5-f532-481b-ac60-9a12bbb5c13a]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flushing IO for device /dev/sdf {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f407f437-56c4-4094-bdfe-6bb4f4492048]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[49199389-982d-49df-8a76-4662023e8811]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] SCSI volumes sdf have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed28a0f2-821c-46b9-b56b-546a33a02296]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[424e1935-18b2-4290-9a14-90ba22472563]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195, portal: 172.16.0.220,3260]
Aug 26 11:58:55 user nova-compute[73068]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195, portal: 172.16.0.220,3260] successful.
Aug 26 11:58:55 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c899aa11-268a-486d-8f68-c2895c92d195 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad95941-5eb6-4590-939b-623888c395c9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] <== disconnect_volume: return (294ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:58:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:58:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:58:56 user nova-compute[73068]: DEBUG nova.objects.instance [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid d74da117-dc27-46b4-897b-763ef5137a6e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-612707a2-e2ec-4ecd-8e14-88102b2acbef tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.649s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:57 user nova-compute[73068]: INFO nova.compute.manager [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Detaching volume c1149199-a249-4775-a120-2763b833778e
Aug 26 11:58:57 user nova-compute[73068]: INFO nova.virt.block_device [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Attempting to driver detach volume c1149199-a249-4775-a120-2763b833778e from mountpoint /dev/vdc
Aug 26 11:58:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Attempting to detach device vdc from instance d74da117-dc27-46b4-897b-763ef5137a6e from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:58:57 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:58:57 user nova-compute[73068]:   <source dev="/dev/sdh"/>
Aug 26 11:58:57 user nova-compute[73068]:   <target dev="vdc" bus="virtio"/>
Aug 26 11:58:57 user nova-compute[73068]:   <serial>c1149199-a249-4775-a120-2763b833778e</serial>
Aug 26 11:58:57 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 11:58:57 user nova-compute[73068]: </disk>
Aug 26 11:58:57 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:58:57 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully detached device vdc from instance d74da117-dc27-46b4-897b-763ef5137a6e from the persistent domain config.
Aug 26 11:58:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d74da117-dc27-46b4-897b-763ef5137a6e from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:58:57 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:58:57 user nova-compute[73068]:   <source dev="/dev/sdh"/>
Aug 26 11:58:57 user nova-compute[73068]:   <target dev="vdc" bus="virtio"/>
Aug 26 11:58:57 user nova-compute[73068]:   <serial>c1149199-a249-4775-a120-2763b833778e</serial>
Aug 26 11:58:57 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 11:58:57 user nova-compute[73068]: </disk>
Aug 26 11:58:57 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693051137.8031397, d74da117-dc27-46b4-897b-763ef5137a6e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d74da117-dc27-46b4-897b-763ef5137a6e {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:58:57 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully detached device vdc from instance d74da117-dc27-46b4-897b-763ef5137a6e from the live domain config.
Aug 26 11:58:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrJztWQl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:57 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1f0690-7660-473c-af4e-6f35a003cd85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[638d543b-0928-425f-b9a6-2de2f05ee4f4]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:57 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:57 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:57 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:57 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:57 user nova-compute[73068]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e (non-flash)
Aug 26 11:58:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:57 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:57 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:57 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:57 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:57 user nova-compute[73068]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e (non-flash)
Aug 26 11:58:57 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb059edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e'): ({'sdh'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Removing single pathed devices sdh {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e72c822-af29-4158-a1bd-b1d82a749cba]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1950a7-4cce-4a76-98de-7f965d3358b0]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Flushing IO for device /dev/sdh {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[380fc0e9-64e6-4cfb-b04e-2cf5288feb09]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9308f0a-4510-4b48-9c1b-5f4dcdd27ae8]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] SCSI volumes sdh have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7563680-2654-43d3-a94f-420207208edd]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:57 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[34886b2e-5670-4687-8751-186b004bb8cb]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e, portal: 172.16.0.220,3260]
Aug 26 11:58:58 user nova-compute[73068]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e, portal: 172.16.0.220,3260] successful.
Aug 26 11:58:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1149199-a249-4775-a120-2763b833778e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f9d740-6130-4a54-92ca-6637e20432bf]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] <== disconnect_volume: return (284ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMdcnvkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:58:58 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:58 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:58:58 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdec566-75e1-4077-a88d-91d1fdd59266]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 11:58:58 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc71a0d-79fc-47b0-bd71-7c8ea897795b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47] added
Aug 26 11:58:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ac37af-1652-4b81-af4b-1d1b353b2f83]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[984b8fd3-4803-4eb4-b335-91bbddc5d53c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AMdcnvkz {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AMdcnvkz" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f42566-0207-4c67-af10-e2d328375970]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AMdcnvkz'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d5cb1f-7482-46cd-8a6d-962cd0c5cfce]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[301d02c7-fa32-46b7-80b3-d8dbb8a251c6]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:58 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:58 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:58 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:58 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:58 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:58 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:58 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:58 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG nova.objects.instance [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'flavor' on Instance uuid d74da117-dc27-46b4-897b-763ef5137a6e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ec06406c-b78c-4b12-8376-4b8bb812c421 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.682s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b117516-f8ad-451c-bccf-596c10faa266]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47, portal: 172.16.0.220,3260]
Aug 26 11:58:58 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47, portal: 172.16.0.220,3260] successful.
Aug 26 11:58:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48ebd05-2ee0-4cf2-9788-82db45442d3c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[194a9b0a-069b-4ff8-a603-953b367343d7]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:59 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:59 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:59 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:59 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:59 user nova-compute[73068]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 (non-flash)
Aug 26 11:58:59 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:58:59 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:58:59 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:58:59 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:58:59 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:58:59 user nova-compute[73068]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 (non-flash)
Aug 26 11:58:59 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f5ea9a-4609-44bb-a3d8-945b6ac9653a]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMdcnvkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:58:59 user nova-compute[73068]: INFO nova.compute.manager [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Terminating instance
Aug 26 11:58:59 user nova-compute[73068]: DEBUG nova.compute.manager [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 11:58:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23666303831376631', 'path': '/dev/sdf'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666303831376631', 'path': '/dev/sdf'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lazy-loading 'flavor' on Instance uuid f024a327-fe6d-4599-9d04-94f7dc54e646 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 11:59:00 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:59:00 user nova-compute[73068]:   <source dev="/dev/sdf"/>
Aug 26 11:59:00 user nova-compute[73068]:   <target dev="vdc" bus="virtio"/>
Aug 26 11:59:00 user nova-compute[73068]:   <serial>fc05d860-b5aa-46e6-808e-5e894bf32e47</serial>
Aug 26 11:59:00 user nova-compute[73068]: </disk>
Aug 26 11:59:00 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-231a9bd4-ebf6-47a1-8cd9-ea00425d844d req-df7fae4e-6769-48ba-827b-33d6f578d9ba service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-vif-unplugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-231a9bd4-ebf6-47a1-8cd9-ea00425d844d req-df7fae4e-6769-48ba-827b-33d6f578d9ba service nova] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-231a9bd4-ebf6-47a1-8cd9-ea00425d844d req-df7fae4e-6769-48ba-827b-33d6f578d9ba service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-231a9bd4-ebf6-47a1-8cd9-ea00425d844d req-df7fae4e-6769-48ba-827b-33d6f578d9ba service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-231a9bd4-ebf6-47a1-8cd9-ea00425d844d req-df7fae4e-6769-48ba-827b-33d6f578d9ba service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] No waiting events found dispatching network-vif-unplugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-231a9bd4-ebf6-47a1-8cd9-ea00425d844d req-df7fae4e-6769-48ba-827b-33d6f578d9ba service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-vif-unplugged-45871af6-d08f-40df-bc66-24eae82b28fc for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] No VIF found with MAC fa:16:3e:a6:4b:b1, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a40fee33-891a-4659-8bf5-048d009883d0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.861s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:00 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Instance destroyed successfully.
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.objects.instance [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lazy-loading 'resources' on Instance uuid d74da117-dc27-46b4-897b-763ef5137a6e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:56:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1377830885',display_name='tempest-AttachVolumeTestJSON-server-1377830885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1377830885',id=37,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsxnls5pSWEI8tJVRT6XWjo8knb/jw0ioODazScLyVBvBW14Z0xQMwhMlQpp6ZzwSSw+lOZfha1HXkAXljtsOPpxp0R24dQGyfOMkRm/2F2mL2mWcUIC5gdQeoyHYxoHg==',key_name='tempest-keypair-620631342',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:56:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='58a6670af78b4f6ea72a6d4bc4274c31',ramdisk_id='',reservation_id='r-03k6g0wc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1485056682',owner_user_name='tempest-AttachVolumeTestJSON-1485056682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:56:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f8285bc9bf348289c10e62f2179a266',uuid=d74da117-dc27-46b4-897b-763ef5137a6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45871af6-d08f-40df-bc66-24eae82b28fc", "address": "fa:16:3e:cc:9c:22", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45871af6-d0", "ovs_interfaceid": "45871af6-d08f-40df-bc66-24eae82b28fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converting VIF {"id": "45871af6-d08f-40df-bc66-24eae82b28fc", "address": "fa:16:3e:cc:9c:22", "network": {"id": "9398992d-3da4-48d4-ac36-d1ddca80d8e7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1548981119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "58a6670af78b4f6ea72a6d4bc4274c31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45871af6-d0", "ovs_interfaceid": "45871af6-d08f-40df-bc66-24eae82b28fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:9c:22,bridge_name='br-int',has_traffic_filtering=True,id=45871af6-d08f-40df-bc66-24eae82b28fc,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45871af6-d0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG os_vif [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:9c:22,bridge_name='br-int',has_traffic_filtering=True,id=45871af6-d08f-40df-bc66-24eae82b28fc,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45871af6-d0') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45871af6-d0, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:59:00 user nova-compute[73068]: INFO os_vif [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:9c:22,bridge_name='br-int',has_traffic_filtering=True,id=45871af6-d08f-40df-bc66-24eae82b28fc,network=Network(9398992d-3da4-48d4-ac36-d1ddca80d8e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45871af6-d0')
Aug 26 11:59:00 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Deleting instance files /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e_del
Aug 26 11:59:00 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Deletion of /opt/stack/data/nova/instances/d74da117-dc27-46b4-897b-763ef5137a6e_del complete
Aug 26 11:59:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:00 user nova-compute[73068]: INFO nova.compute.manager [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 26 11:59:00 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 11:59:00 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 11:59:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:59:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:59:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:59:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:59:02 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Took 1.22 seconds to deallocate network for instance.
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-210e0fe7-c8b1-46b7-a4cd-47704787a407 req-48c0b809-6e97-4f73-9819-af3c2091c8b3 service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-vif-deleted-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:02 user nova-compute[73068]: INFO nova.compute.manager [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Detaching volume fc05d860-b5aa-46e6-808e-5e894bf32e47
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] No waiting events found dispatching network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:59:02 user nova-compute[73068]: WARNING nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received unexpected event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc for instance with vm_state deleted and task_state None.
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] No waiting events found dispatching network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:59:02 user nova-compute[73068]: WARNING nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received unexpected event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc for instance with vm_state deleted and task_state None.
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] No waiting events found dispatching network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:59:02 user nova-compute[73068]: WARNING nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received unexpected event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc for instance with vm_state deleted and task_state None.
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-vif-unplugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] No waiting events found dispatching network-vif-unplugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:59:02 user nova-compute[73068]: WARNING nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received unexpected event network-vif-unplugged-45871af6-d08f-40df-bc66-24eae82b28fc for instance with vm_state deleted and task_state None.
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Acquiring lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] Lock "d74da117-dc27-46b4-897b-763ef5137a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] No waiting events found dispatching network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:59:02 user nova-compute[73068]: WARNING nova.compute.manager [req-828905f1-ddd7-41a6-9d83-e2daa452e7ff req-9fc45a28-dff4-468b-bab3-892c7a23cb6b service nova] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Received unexpected event network-vif-plugged-45871af6-d08f-40df-bc66-24eae82b28fc for instance with vm_state deleted and task_state None.
Aug 26 11:59:02 user nova-compute[73068]: INFO nova.virt.block_device [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Attempting to driver detach volume fc05d860-b5aa-46e6-808e-5e894bf32e47 from mountpoint /dev/vdc
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Attempting to detach device vdc from instance f024a327-fe6d-4599-9d04-94f7dc54e646 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:59:02 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:59:02 user nova-compute[73068]:   <source dev="/dev/sdf"/>
Aug 26 11:59:02 user nova-compute[73068]:   <target dev="vdc" bus="virtio"/>
Aug 26 11:59:02 user nova-compute[73068]:   <serial>fc05d860-b5aa-46e6-808e-5e894bf32e47</serial>
Aug 26 11:59:02 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 11:59:02 user nova-compute[73068]: </disk>
Aug 26 11:59:02 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:59:02 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Successfully detached device vdc from instance f024a327-fe6d-4599-9d04-94f7dc54e646 from the persistent domain config.
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f024a327-fe6d-4599-9d04-94f7dc54e646 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:59:02 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:59:02 user nova-compute[73068]:   <source dev="/dev/sdf"/>
Aug 26 11:59:02 user nova-compute[73068]:   <target dev="vdc" bus="virtio"/>
Aug 26 11:59:02 user nova-compute[73068]:   <serial>fc05d860-b5aa-46e6-808e-5e894bf32e47</serial>
Aug 26 11:59:02 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 11:59:02 user nova-compute[73068]: </disk>
Aug 26 11:59:02 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:02 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Deleted allocations for instance d74da117-dc27-46b4-897b-763ef5137a6e
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-657f2ddd-5f3a-49c4-83b9-6dbdcdd64be0 tempest-AttachVolumeTestJSON-1485056682 tempest-AttachVolumeTestJSON-1485056682-project-member] Lock "d74da117-dc27-46b4-897b-763ef5137a6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.903s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693051142.840225, f024a327-fe6d-4599-9d04-94f7dc54e646 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f024a327-fe6d-4599-9d04-94f7dc54e646 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:59:02 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Successfully detached device vdc from instance f024a327-fe6d-4599-9d04-94f7dc54e646 from the live domain config.
Aug 26 11:59:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMdcnvkz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:59:02 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:59:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd7a49c-6043-4058-a841-8c6fe721d69e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8297a1ad-8438-42e5-bf3a-7b361b4a58dc]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:59:02 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:59:02 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:59:02 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:59:02 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:59:02 user nova-compute[73068]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 (non-flash)
Aug 26 11:59:02 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:59:02 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:59:02 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:59:02 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:59:02 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:59:02 user nova-compute[73068]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 (non-flash)
Aug 26 11:59:02 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddbf8fa290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47'): ({'sdf'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Removing single pathed devices sdf {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f1505a-acc9-4e69-9d2a-718075638060]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1195c51c-2308-4368-90d1-b643a39fe09b]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Flushing IO for device /dev/sdf {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4fc97c-fc00-4490-bebd-9b0f8292b9f2]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:59:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4900717b-967d-4208-9c7e-b2c0282b37a0]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] SCSI volumes sdf have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87c7244-1908-43ca-96f3-a0eb564b73d6]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4673dd12-2ab3-4f72-8637-5fcf600a111a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47, portal: 172.16.0.220,3260]
Aug 26 11:59:03 user nova-compute[73068]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47, portal: 172.16.0.220,3260] successful.
Aug 26 11:59:03 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc05d860-b5aa-46e6-808e-5e894bf32e47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36bb6ed-9fe8-4203-adc3-ed381391ac4d]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] <== disconnect_volume: return (314ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG nova.compute.manager [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:59:03 user nova-compute[73068]: INFO nova.compute.manager [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] instance snapshotting
Aug 26 11:59:03 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Beginning live snapshot process
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json -f qcow2 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json -f qcow2 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:03 user nova-compute[73068]: DEBUG nova.objects.instance [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lazy-loading 'flavor' on Instance uuid f024a327-fe6d-4599-9d04-94f7dc54e646 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:59:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-2f4597ca-6821-42f6-83b5-5e588bf75d34 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.833s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2tcgjg5s/c397e04f7dec4b5daa91c0eee43ea708.delta 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2tcgjg5s/c397e04f7dec4b5daa91c0eee43ea708.delta 1073741824" returned: 0 in 0.060s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:04 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 11:59:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:59:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73068) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 11:59:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73068) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 11:59:05 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 11:59:05 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 11:59:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2tcgjg5s/c397e04f7dec4b5daa91c0eee43ea708.delta /opt/stack/data/nova/instances/snapshots/tmp2tcgjg5s/c397e04f7dec4b5daa91c0eee43ea708 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2tcgjg5s/c397e04f7dec4b5daa91c0eee43ea708.delta /opt/stack/data/nova/instances/snapshots/tmp2tcgjg5s/c397e04f7dec4b5daa91c0eee43ea708" returned: 0 in 0.551s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:06 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Snapshot extracted, beginning image upload
Aug 26 11:59:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:59:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:59:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:07 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 11:59:07 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:59:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:07 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:08 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Snapshot image upload complete
Aug 26 11:59:08 user nova-compute[73068]: INFO nova.compute.manager [None req-99bf21df-7972-4621-ba46-5b4c57ab64e0 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Took 5.16 seconds to snapshot the instance on the hypervisor.
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:59:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:59:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 11:59:10 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:59:10 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7724MB free_disk=25.084606170654297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance bb9c655d-7e26-45bd-9e28-a695ca25a69b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 1af1b911-507d-4303-bf15-b0ebc8b86665 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance f024a327-fe6d-4599-9d04-94f7dc54e646 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance b148f5b5-ada4-49a6-9e9c-cd04283223ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 88e1f171-b5e8-4164-a659-69f8fdc653ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:59:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:59:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 11:59:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:59:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:59:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 11:59:12 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Updating instance_info_cache with network_info: [{"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:59:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:59:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 11:59:15 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051140.7781863, d74da117-dc27-46b4-897b-763ef5137a6e => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 11:59:15 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] VM Stopped (Lifecycle Event)
Aug 26 11:59:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a38bf795-39bc-46eb-a471-43df5729a51d None None] [instance: d74da117-dc27-46b4-897b-763ef5137a6e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:59:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:59:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:59:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:59:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:59:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:20 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 11:59:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-d66d0973-c517-43ff-bb5c-4768d882fa9c req-a8936739-e3fc-4a77-9d14-84214f9c14ef service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-changed-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-d66d0973-c517-43ff-bb5c-4768d882fa9c req-a8936739-e3fc-4a77-9d14-84214f9c14ef service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Refreshing instance network info cache due to event network-changed-5e4a0bfe-be50-46d7-a4db-56790f1cb09c. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d66d0973-c517-43ff-bb5c-4768d882fa9c req-a8936739-e3fc-4a77-9d14-84214f9c14ef service nova] Acquiring lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d66d0973-c517-43ff-bb5c-4768d882fa9c req-a8936739-e3fc-4a77-9d14-84214f9c14ef service nova] Acquired lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-d66d0973-c517-43ff-bb5c-4768d882fa9c req-a8936739-e3fc-4a77-9d14-84214f9c14ef service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Refreshing network info cache for port 5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-d66d0973-c517-43ff-bb5c-4768d882fa9c req-a8936739-e3fc-4a77-9d14-84214f9c14ef service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updated VIF entry in instance network info cache for port 5e4a0bfe-be50-46d7-a4db-56790f1cb09c. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-d66d0973-c517-43ff-bb5c-4768d882fa9c req-a8936739-e3fc-4a77-9d14-84214f9c14ef service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updating instance_info_cache with network_info: [{"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d66d0973-c517-43ff-bb5c-4768d882fa9c req-a8936739-e3fc-4a77-9d14-84214f9c14ef service nova] Releasing lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-50797a04-c111-41f8-814c-e4d76af31e36 req-677e5c54-9f40-4e3a-bbb7-dd01263bbf6b service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-changed-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-50797a04-c111-41f8-814c-e4d76af31e36 req-677e5c54-9f40-4e3a-bbb7-dd01263bbf6b service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Refreshing instance network info cache due to event network-changed-5e4a0bfe-be50-46d7-a4db-56790f1cb09c. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-50797a04-c111-41f8-814c-e4d76af31e36 req-677e5c54-9f40-4e3a-bbb7-dd01263bbf6b service nova] Acquiring lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-50797a04-c111-41f8-814c-e4d76af31e36 req-677e5c54-9f40-4e3a-bbb7-dd01263bbf6b service nova] Acquired lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.network.neutron [req-50797a04-c111-41f8-814c-e4d76af31e36 req-677e5c54-9f40-4e3a-bbb7-dd01263bbf6b service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Refreshing network info cache for port 5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:36 user nova-compute[73068]: INFO nova.compute.manager [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Detaching volume 2622b9d1-e7fd-4636-9f28-3c7c1d0ff028
Aug 26 11:59:36 user nova-compute[73068]: INFO nova.virt.block_device [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Attempting to driver detach volume 2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 from mountpoint /dev/vdb
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Attempting to detach device vdb from instance bb9c655d-7e26-45bd-9e28-a695ca25a69b from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:59:36 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:59:36 user nova-compute[73068]:   <source dev="/dev/sdd"/>
Aug 26 11:59:36 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:59:36 user nova-compute[73068]:   <serial>2622b9d1-e7fd-4636-9f28-3c7c1d0ff028</serial>
Aug 26 11:59:36 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:59:36 user nova-compute[73068]: </disk>
Aug 26 11:59:36 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:59:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Successfully detached device vdb from instance bb9c655d-7e26-45bd-9e28-a695ca25a69b from the persistent domain config.
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb9c655d-7e26-45bd-9e28-a695ca25a69b from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:59:36 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:59:36 user nova-compute[73068]:   <source dev="/dev/sdd"/>
Aug 26 11:59:36 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:59:36 user nova-compute[73068]:   <serial>2622b9d1-e7fd-4636-9f28-3c7c1d0ff028</serial>
Aug 26 11:59:36 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:59:36 user nova-compute[73068]: </disk>
Aug 26 11:59:36 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.network.neutron [req-50797a04-c111-41f8-814c-e4d76af31e36 req-677e5c54-9f40-4e3a-bbb7-dd01263bbf6b service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updated VIF entry in instance network info cache for port 5e4a0bfe-be50-46d7-a4db-56790f1cb09c. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.network.neutron [req-50797a04-c111-41f8-814c-e4d76af31e36 req-677e5c54-9f40-4e3a-bbb7-dd01263bbf6b service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updating instance_info_cache with network_info: [{"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-50797a04-c111-41f8-814c-e4d76af31e36 req-677e5c54-9f40-4e3a-bbb7-dd01263bbf6b service nova] Releasing lock "refresh_cache-bb9c655d-7e26-45bd-9e28-a695ca25a69b" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693051176.9498873, bb9c655d-7e26-45bd-9e28-a695ca25a69b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb9c655d-7e26-45bd-9e28-a695ca25a69b {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:59:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Successfully detached device vdb from instance bb9c655d-7e26-45bd-9e28-a695ca25a69b from the live domain config.
Aug 26 11:59:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ImnhBHXV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:59:36 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:59:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[136239e3-9b9e-4f14-8895-c09112a67719]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[571cdffe-f59a-45ff-ba06-778ba1aef8d5]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:59:37 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:59:37 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:59:37 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:59:37 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:59:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:59:37 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:59:37 user nova-compute[73068]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 (non-flash)
Aug 26 11:59:37 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:59:37 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:59:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb059e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028'): ({'sdd'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Removing single pathed devices sdd {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d3eae1-eac6-4887-b49c-ec6a86dbb8a5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[696822b4-5a13-465b-bab0-777297f98fe8]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Flushing IO for device /dev/sdd {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8148b1-081f-48c8-96d6-7f0f17ee910c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f3c06b-c6ba-4f9a-8675-ae37d97c97ae]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[10914045-ac30-497e-abb5-a443e66bc8db]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47a825a-7a5c-4437-9139-0c9be2da6fbe]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028, portal: 172.16.0.220,3260]
Aug 26 11:59:37 user nova-compute[73068]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028, portal: 172.16.0.220,3260] successful.
Aug 26 11:59:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2622b9d1-e7fd-4636-9f28-3c7c1d0ff028 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b38dda-6de3-4987-b174-ffa0a9ae8c29]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] <== disconnect_volume: return (281ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:59:37 user nova-compute[73068]: DEBUG nova.objects.instance [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'flavor' on Instance uuid bb9c655d-7e26-45bd-9e28-a695ca25a69b {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:59:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-acdc4d4d-e1bf-4825-82c5-2e822a0d03ab tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.656s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:52 user nova-compute[73068]: INFO nova.compute.manager [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Detaching volume 116b403b-90f4-470c-b001-0afad386d205
Aug 26 11:59:52 user nova-compute[73068]: INFO nova.virt.block_device [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Attempting to driver detach volume 116b403b-90f4-470c-b001-0afad386d205 from mountpoint /dev/vdb
Aug 26 11:59:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Attempting to detach device vdb from instance f024a327-fe6d-4599-9d04-94f7dc54e646 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 11:59:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:59:52 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:59:52 user nova-compute[73068]:   <source dev="/dev/sdg"/>
Aug 26 11:59:52 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:59:52 user nova-compute[73068]:   <serial>116b403b-90f4-470c-b001-0afad386d205</serial>
Aug 26 11:59:52 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:59:52 user nova-compute[73068]: </disk>
Aug 26 11:59:52 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:59:52 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Successfully detached device vdb from instance f024a327-fe6d-4599-9d04-94f7dc54e646 from the persistent domain config.
Aug 26 11:59:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f024a327-fe6d-4599-9d04-94f7dc54e646 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 11:59:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 11:59:52 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 11:59:52 user nova-compute[73068]:   <source dev="/dev/sdg"/>
Aug 26 11:59:52 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 11:59:52 user nova-compute[73068]:   <serial>116b403b-90f4-470c-b001-0afad386d205</serial>
Aug 26 11:59:52 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 11:59:52 user nova-compute[73068]: </disk>
Aug 26 11:59:52 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693051193.2367134, f024a327-fe6d-4599-9d04-94f7dc54e646 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f024a327-fe6d-4599-9d04-94f7dc54e646 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 11:59:53 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Successfully detached device vdb from instance f024a327-fe6d-4599-9d04-94f7dc54e646 from the live domain config.
Aug 26 11:59:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BUVChOEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 11:59:53 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2bf7ac-20e8-4609-b461-1636fa361cdb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[120f6456-1326-4ace-8d52-62b3d5bbca23]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:59:53 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:59:53 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:59:53 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:59:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 11:59:53 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 11:59:53 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 11:59:53 user nova-compute[73068]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 (non-flash)
Aug 26 11:59:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd902d4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205'): ({'sdg'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Removing single pathed devices sdg {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dafc64-af3e-40e6-a3a6-ba48a3dc587f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9e508e-8ae2-4c72-98d4-a1862ebfd31c]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Flushing IO for device /dev/sdg {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0206d7-2e3a-43ba-949d-b63b57c2f0ab]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afdc681-4e39-4d8c-ad28-d019c73dc031]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] SCSI volumes sdg have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac605200-557d-4479-a039-a910a6035801]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf6040d-1d88-4621-9837-81747d4a67d5]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205, portal: 172.16.0.220,3260]
Aug 26 11:59:53 user nova-compute[73068]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205, portal: 172.16.0.220,3260] successful.
Aug 26 11:59:53 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116b403b-90f4-470c-b001-0afad386d205 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bd132a-5e05-4187-83ec-0dd831b3013f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] <== disconnect_volume: return (297ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 11:59:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 11:59:54 user nova-compute[73068]: DEBUG nova.objects.instance [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lazy-loading 'flavor' on Instance uuid f024a327-fe6d-4599-9d04-94f7dc54e646 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 11:59:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-4e8c6ef0-b15e-458c-8110-e6b401ea0be0 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.662s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 11:59:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 11:59:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:59:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 11:59:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:58 user nova-compute[73068]: DEBUG nova.compute.manager [req-6c664b57-67d9-4e17-a079-ca2329015a89 req-9d2b8ab0-a257-4719-ba31-b34e9bd057c6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-changed-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:59:58 user nova-compute[73068]: DEBUG nova.compute.manager [req-6c664b57-67d9-4e17-a079-ca2329015a89 req-9d2b8ab0-a257-4719-ba31-b34e9bd057c6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Refreshing instance network info cache due to event network-changed-fd463838-cf9f-4607-a540-856cf74753d9. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 11:59:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6c664b57-67d9-4e17-a079-ca2329015a89 req-9d2b8ab0-a257-4719-ba31-b34e9bd057c6 service nova] Acquiring lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:59:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6c664b57-67d9-4e17-a079-ca2329015a89 req-9d2b8ab0-a257-4719-ba31-b34e9bd057c6 service nova] Acquired lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:59:58 user nova-compute[73068]: DEBUG nova.network.neutron [req-6c664b57-67d9-4e17-a079-ca2329015a89 req-9d2b8ab0-a257-4719-ba31-b34e9bd057c6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Refreshing network info cache for port fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:59 user nova-compute[73068]: INFO nova.compute.manager [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Shelve offloading
Aug 26 11:59:59 user nova-compute[73068]: DEBUG nova.network.neutron [req-6c664b57-67d9-4e17-a079-ca2329015a89 req-9d2b8ab0-a257-4719-ba31-b34e9bd057c6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updated VIF entry in instance network info cache for port fd463838-cf9f-4607-a540-856cf74753d9. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG nova.network.neutron [req-6c664b57-67d9-4e17-a079-ca2329015a89 req-9d2b8ab0-a257-4719-ba31-b34e9bd057c6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating instance_info_cache with network_info: [{"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6c664b57-67d9-4e17-a079-ca2329015a89 req-9d2b8ab0-a257-4719-ba31-b34e9bd057c6 service nova] Releasing lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-732c5ebb-62f2-4dc4-bafa-a84d05eb0746 req-1a8fe9cf-ad9f-4616-83ed-c5c1eb0785d9 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-unplugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-732c5ebb-62f2-4dc4-bafa-a84d05eb0746 req-1a8fe9cf-ad9f-4616-83ed-c5c1eb0785d9 service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-732c5ebb-62f2-4dc4-bafa-a84d05eb0746 req-1a8fe9cf-ad9f-4616-83ed-c5c1eb0785d9 service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-732c5ebb-62f2-4dc4-bafa-a84d05eb0746 req-1a8fe9cf-ad9f-4616-83ed-c5c1eb0785d9 service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-732c5ebb-62f2-4dc4-bafa-a84d05eb0746 req-1a8fe9cf-ad9f-4616-83ed-c5c1eb0785d9 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-unplugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 11:59:59 user nova-compute[73068]: WARNING nova.compute.manager [req-732c5ebb-62f2-4dc4-bafa-a84d05eb0746 req-1a8fe9cf-ad9f-4616-83ed-c5c1eb0785d9 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received unexpected event network-vif-unplugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with vm_state active and task_state shelving.
Aug 26 11:59:59 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Instance destroyed successfully.
Aug 26 11:59:59 user nova-compute[73068]: DEBUG nova.compute.manager [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquired lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 11:59:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:00:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG nova.network.neutron [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating instance_info_cache with network_info: [{"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Releasing lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG nova.compute.manager [req-27784c57-37ba-40d1-97d5-d4ed861209f9 req-cb306225-7581-4fee-951e-576f9cee51bf service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-27784c57-37ba-40d1-97d5-d4ed861209f9 req-cb306225-7581-4fee-951e-576f9cee51bf service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-27784c57-37ba-40d1-97d5-d4ed861209f9 req-cb306225-7581-4fee-951e-576f9cee51bf service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-27784c57-37ba-40d1-97d5-d4ed861209f9 req-cb306225-7581-4fee-951e-576f9cee51bf service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG nova.compute.manager [req-27784c57-37ba-40d1-97d5-d4ed861209f9 req-cb306225-7581-4fee-951e-576f9cee51bf service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:00:01 user nova-compute[73068]: WARNING nova.compute.manager [req-27784c57-37ba-40d1-97d5-d4ed861209f9 req-cb306225-7581-4fee-951e-576f9cee51bf service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received unexpected event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with vm_state active and task_state shelving.
Aug 26 12:00:01 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Instance destroyed successfully.
Aug 26 12:00:01 user nova-compute[73068]: DEBUG nova.objects.instance [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lazy-loading 'resources' on Instance uuid 88e1f171-b5e8-4164-a659-69f8fdc653ed {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1280182601',display_name='tempest-TestShelveInstance-server-1280182601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1280182601',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGL8Ha7TtzLXzshoSYdSUgbeLXe4Fjn3BpBi7Ymb/G4hsJYJn7NLJ42fo8AhnamN8TZF6r1Zn9z8XzPVcto8SGXZ7Rl9pONBpfaOg3kTKzx2H0ctmX5UTLNwyl9q0NLLQ==',key_name='tempest-TestShelveInstance-2008128873',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4d268fa0703413ca9f163a0891bc202',ramdisk_id='',reservation_id='r-80efw2yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1913379620',owner_user_name='tempest-TestShelveInstance-1913379620-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:58:25Z,user_data=None,user_id='7ee37cf249774afdad5850676ccae88f',uuid=88e1f171-b5e8-4164-a659-69f8fdc653ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converting VIF {"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG os_vif [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd463838-cf, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:01 user nova-compute[73068]: INFO os_vif [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf')
Aug 26 12:00:01 user nova-compute[73068]: DEBUG nova.compute.manager [req-2979bda1-a3ec-43d7-acfe-fea03d8f4849 req-4f07e12e-d79f-43dc-a406-3a94fbf0e0d6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-changed-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG nova.compute.manager [req-2979bda1-a3ec-43d7-acfe-fea03d8f4849 req-4f07e12e-d79f-43dc-a406-3a94fbf0e0d6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Refreshing instance network info cache due to event network-changed-fd463838-cf9f-4607-a540-856cf74753d9. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2979bda1-a3ec-43d7-acfe-fea03d8f4849 req-4f07e12e-d79f-43dc-a406-3a94fbf0e0d6 service nova] Acquiring lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2979bda1-a3ec-43d7-acfe-fea03d8f4849 req-4f07e12e-d79f-43dc-a406-3a94fbf0e0d6 service nova] Acquired lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG nova.network.neutron [req-2979bda1-a3ec-43d7-acfe-fea03d8f4849 req-4f07e12e-d79f-43dc-a406-3a94fbf0e0d6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Refreshing network info cache for port fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Qmktbyxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:00:01 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:00:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc823f4-6e01-4da0-9fe2-24dea4586a47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22a48f2-018c-4581-ac05-3fef3c5d19f4]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:00:01 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 12:00:01 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 12:00:01 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:00:01 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 12:00:01 user nova-compute[73068]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 12:00:01 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd902d7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3'): ({'sde'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Removing single pathed devices sde {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc558667-8540-49df-bdfe-aa3cad745253]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0984c33b-8a7d-44bc-9a68-427975f22295]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Flushing IO for device /dev/sde {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d0dd5d-5a7f-4c0a-a0e9-7bfe02147c7c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:00:01 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7d5126-02fc-4316-b4f4-431c6130ebb7]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] SCSI volumes sde have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.063s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fd1e90-9e5a-4489-ab41-21fbba49d153]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef73ccb1-a95a-4b8e-ad11-65fa5576a3ca]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260]
Aug 26 12:00:02 user nova-compute[73068]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260] successful.
Aug 26 12:00:02 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a9dae1-8a9e-4d8e-84ff-1f84bf927088]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] <== disconnect_volume: return (399ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:00:02 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Deleting instance files /opt/stack/data/nova/instances/88e1f171-b5e8-4164-a659-69f8fdc653ed_del
Aug 26 12:00:02 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Deletion of /opt/stack/data/nova/instances/88e1f171-b5e8-4164-a659-69f8fdc653ed_del complete
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG nova.network.neutron [req-2979bda1-a3ec-43d7-acfe-fea03d8f4849 req-4f07e12e-d79f-43dc-a406-3a94fbf0e0d6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updated VIF entry in instance network info cache for port fd463838-cf9f-4607-a540-856cf74753d9. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG nova.network.neutron [req-2979bda1-a3ec-43d7-acfe-fea03d8f4849 req-4f07e12e-d79f-43dc-a406-3a94fbf0e0d6 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating instance_info_cache with network_info: [{"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": null, "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfd463838-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:00:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2979bda1-a3ec-43d7-acfe-fea03d8f4849 req-4f07e12e-d79f-43dc-a406-3a94fbf0e0d6 service nova] Releasing lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:00:03 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Deleted allocations for instance 88e1f171-b5e8-4164-a659-69f8fdc653ed
Aug 26 12:00:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:03 user nova-compute[73068]: DEBUG nova.objects.instance [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lazy-loading 'numa_topology' on Instance uuid 88e1f171-b5e8-4164-a659-69f8fdc653ed {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:00:03 user nova-compute[73068]: DEBUG nova.objects.base [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Object Instance<88e1f171-b5e8-4164-a659-69f8fdc653ed> lazy-loaded attributes: resources,numa_topology {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:00:03 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:00:03 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:00:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-59c49949-2e8d-42a4-9275-e807e23596b0 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.616s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:00:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:00:05 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:00:05 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:00:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:00:08 user nova-compute[73068]: INFO nova.compute.manager [None req-b60f3f31-3696-4d8e-b3f0-e093eaa3f12c tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Get console output
Aug 26 12:00:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:00:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:00:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:00:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:00:08 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:00:08 user nova-compute[73068]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 26 12:00:09 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating instance_info_cache with network_info: [{"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-1af1b911-507d-4303-bf15-b0ebc8b86665" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:00:11 user nova-compute[73068]: INFO nova.compute.claims [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Claim successful on node user
Aug 26 12:00:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:00:11 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:00:11 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:00:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8031MB free_disk=25.082813262939453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.718s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:00:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.198s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:00:12 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance bb9c655d-7e26-45bd-9e28-a695ca25a69b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 1af1b911-507d-4303-bf15-b0ebc8b86665 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance f024a327-fe6d-4599-9d04-94f7dc54e646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance b148f5b5-ada4-49a6-9e9c-cd04283223ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8bd308c4-54d4-4883-bf71-9e7c60f79b51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.policy [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9cd2bf96810a4540969277c8f94d5a6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20a527043d44250bfe0a4b9dbf3e00d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:00:12 user nova-compute[73068]: INFO nova.virt.block_device [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Booting with volume-backed-image 7a04c5f4-de55-416c-8955-be802fd6bf8e at /dev/vda
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Successfully created port: cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:00:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Successfully updated port: cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:00:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:00:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquired lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:00:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-cc7e0c80-1c21-4739-a49a-b94f6c4d1b58 req-21f4fdef-3bfd-43a9-8f5f-460b726f8c84 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-changed-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-cc7e0c80-1c21-4739-a49a-b94f6c4d1b58 req-21f4fdef-3bfd-43a9-8f5f-460b726f8c84 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Refreshing instance network info cache due to event network-changed-cd87c374-80d6-476b-99c0-0f1e9e1f960f. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cc7e0c80-1c21-4739-a49a-b94f6c4d1b58 req-21f4fdef-3bfd-43a9-8f5f-460b726f8c84 service nova] Acquiring lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Updating instance_info_cache with network_info: [{"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Releasing lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Instance network_info: |[{"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cc7e0c80-1c21-4739-a49a-b94f6c4d1b58 req-21f4fdef-3bfd-43a9-8f5f-460b726f8c84 service nova] Acquired lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-cc7e0c80-1c21-4739-a49a-b94f6c4d1b58 req-21f4fdef-3bfd-43a9-8f5f-460b726f8c84 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Refreshing network info cache for port cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-cc7e0c80-1c21-4739-a49a-b94f6c4d1b58 req-21f4fdef-3bfd-43a9-8f5f-460b726f8c84 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Updated VIF entry in instance network info cache for port cd87c374-80d6-476b-99c0-0f1e9e1f960f. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-cc7e0c80-1c21-4739-a49a-b94f6c4d1b58 req-21f4fdef-3bfd-43a9-8f5f-460b726f8c84 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Updating instance_info_cache with network_info: [{"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cc7e0c80-1c21-4739-a49a-b94f6c4d1b58 req-21f4fdef-3bfd-43a9-8f5f-460b726f8c84 service nova] Releasing lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:00:14 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051199.9696722, 88e1f171-b5e8-4164-a659-69f8fdc653ed => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:00:14 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] VM Stopped (Lifecycle Event)
Aug 26 12:00:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-fb7e00a7-04bd-410d-ad17-33dc40334966 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:00:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:00:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:00:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:00:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:00:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:22 user nova-compute[73068]: DEBUG os_brick.utils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:00:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:22 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee938cc-127d-4185-b971-a8a3846f9c8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:22 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[858680a4-f229-442c-bdd4-b46dde50fbdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[238422be-2b36-4a25-9291-130198537c40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9bb576-6189-4614-915e-fd107a3358de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:00:23 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:00:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2672a70a-0729-468a-886f-526946921b5a]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG os_brick.utils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:00:23 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Updating existing volume attachment record: 3d01c763-8829-4e8f-8b79-401fa5e618a3 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:00:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:34 user nova-compute[73068]: INFO nova.compute.manager [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Terminating instance
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:00:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Creating image(s)
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Ensure instance console log exists: /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Start _get_guest_xml network_info=[{"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '3d01c763-8829-4e8f-8b79-401fa5e618a3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOumRbPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8bd308c4-54d4-4883-bf71-9e7c60f79b51', 'attached_at': '', 'detached_at': '', 'volume_id': '25b88969-11a4-4f67-a156-d59abc039ddc', 'serial': '25b88969-11a4-4f67-a156-d59abc039ddc'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:00:34 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:00:34 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOumRbPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:00:34 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:00:34 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:00:34 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a86a71a-e9ab-4f2e-9feb-8523d536e3ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:00:34 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3457197-e56d-4045-a1e9-8cfb9d9530ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc] added
Aug 26 12:00:34 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8f4d4a-af4e-4b83-9491-00ede458d34a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b0938f-811d-4eb8-ac61-f9e97fe44307]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aOumRbPH {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aOumRbPH" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f6ba92-20cd-4603-a55c-2ca794177500]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aOumRbPH'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a981af-6edd-4e2f-9082-1165cbd9126f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-656cf957-1e6e-400d-b3ec-523ff6f43231 req-4576bd3e-63b8-4727-9827-d3bf538b5e79 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-vif-unplugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-656cf957-1e6e-400d-b3ec-523ff6f43231 req-4576bd3e-63b8-4727-9827-d3bf538b5e79 service nova] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-656cf957-1e6e-400d-b3ec-523ff6f43231 req-4576bd3e-63b8-4727-9827-d3bf538b5e79 service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-656cf957-1e6e-400d-b3ec-523ff6f43231 req-4576bd3e-63b8-4727-9827-d3bf538b5e79 service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-656cf957-1e6e-400d-b3ec-523ff6f43231 req-4576bd3e-63b8-4727-9827-d3bf538b5e79 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] No waiting events found dispatching network-vif-unplugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-656cf957-1e6e-400d-b3ec-523ff6f43231 req-4576bd3e-63b8-4727-9827-d3bf538b5e79 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-vif-unplugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ecbd15-2980-4135-9f49-a01a9f420811]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:00:34 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 12:00:34 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:00:34 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 12:00:34 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f4d7db-fed0-47ad-9fae-1343119e42a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc, portal: 172.16.0.220,3260]
Aug 26 12:00:34 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc, portal: 172.16.0.220,3260] successful.
Aug 26 12:00:34 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c71e0fc-9759-495e-9196-2a2cd2742e1c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec59e486-3ec4-4487-a463-61778c6ec596]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:00:34 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 12:00:34 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:00:34 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:00:34 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 12:00:34 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:00:34 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:00:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dd25fd-d586-41e5-a574-9fabd904c82f]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOumRbPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:35 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Instance destroyed successfully.
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lazy-loading 'resources' on Instance uuid bb9c655d-7e26-45bd-9e28-a695ca25a69b {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-796775537',display_name='tempest-TestMinimumBasicScenario-server-796775537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-796775537',id=36,image_ref='3d553372-00b7-4300-b736-c403e601179f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9lmlNhLPGh/3tbaY2yFkt1XX/vcvzIk1Go5Tvx4mZgTpgDaFJoGQCAG6g1wKc9LLge/aBV2lV2akazaoLWoFn+yhmh59Zd163VEM9sy7DFnaf/SDI/J7NY82vz6q+v6w==',key_name='tempest-TestMinimumBasicScenario-673523517',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:55:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6dcb9735c89849778fdb45c0ac6928a8',ramdisk_id='',reservation_id='r-a2499bqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='3d553372-00b7-4300-b736-c403e601179f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-143892643',owner_user_name='tempest-TestMinimumBasicScenario-143892643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:57:51Z,user_data=None,user_id='ed16b9cc5d7545dc842e87d9cc7b234e',uuid=bb9c655d-7e26-45bd-9e28-a695ca25a69b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converting VIF {"id": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "address": "fa:16:3e:2f:a0:52", "network": {"id": "1d04c9ef-4843-472b-856f-cf730b2e476d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-237838419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6dcb9735c89849778fdb45c0ac6928a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e4a0bfe-be", "ovs_interfaceid": "5e4a0bfe-be50-46d7-a4db-56790f1cb09c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:a0:52,bridge_name='br-int',has_traffic_filtering=True,id=5e4a0bfe-be50-46d7-a4db-56790f1cb09c,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4a0bfe-be') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG os_vif [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:a0:52,bridge_name='br-int',has_traffic_filtering=True,id=5e4a0bfe-be50-46d7-a4db-56790f1cb09c,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4a0bfe-be') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e4a0bfe-be, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:00:35 user nova-compute[73068]: INFO os_vif [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:a0:52,bridge_name='br-int',has_traffic_filtering=True,id=5e4a0bfe-be50-46d7-a4db-56790f1cb09c,network=Network(1d04c9ef-4843-472b-856f-cf730b2e476d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e4a0bfe-be')
Aug 26 12:00:35 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Deleting instance files /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b_del
Aug 26 12:00:35 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Deletion of /opt/stack/data/nova/instances/bb9c655d-7e26-45bd-9e28-a695ca25a69b_del complete
Aug 26 12:00:35 user nova-compute[73068]: INFO nova.compute.manager [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 26 12:00:35 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23433643830326364', 'path': '/dev/sdd'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433643830326364', 'path': '/dev/sdd'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-153523745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-153523745',id=41,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-wu1tx9q6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:00:12Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=8bd308c4-54d4-4883-bf71-9e7c60f79b51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:68:20,bridge_name='br-int',has_traffic_filtering=True,id=cd87c374-80d6-476b-99c0-0f1e9e1f960f,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd87c374-80') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bd308c4-54d4-4883-bf71-9e7c60f79b51 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:00:35 user nova-compute[73068]:   <uuid>8bd308c4-54d4-4883-bf71-9e7c60f79b51</uuid>
Aug 26 12:00:35 user nova-compute[73068]:   <name>instance-00000029</name>
Aug 26 12:00:35 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:00:35 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:00:35 user nova-compute[73068]:   <metadata>
Aug 26 12:00:35 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:00:35 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:00:35 user nova-compute[73068]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-153523745</nova:name>
Aug 26 12:00:35 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:00:34</nova:creationTime>
Aug 26 12:00:35 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:00:35 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:00:35 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:00:35 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:00:35 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:00:35 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:00:35 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:00:35 user nova-compute[73068]:       <nova:owner>
Aug 26 12:00:35 user nova-compute[73068]:         <nova:user uuid="9cd2bf96810a4540969277c8f94d5a6d">tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member</nova:user>
Aug 26 12:00:35 user nova-compute[73068]:         <nova:project uuid="d20a527043d44250bfe0a4b9dbf3e00d">tempest-ServerBootFromVolumeStableRescueTest-343541457</nova:project>
Aug 26 12:00:35 user nova-compute[73068]:       </nova:owner>
Aug 26 12:00:35 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 12:00:35 user nova-compute[73068]:       <nova:ports>
Aug 26 12:00:35 user nova-compute[73068]:         <nova:port uuid="cd87c374-80d6-476b-99c0-0f1e9e1f960f">
Aug 26 12:00:35 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 12:00:35 user nova-compute[73068]:         </nova:port>
Aug 26 12:00:35 user nova-compute[73068]:       </nova:ports>
Aug 26 12:00:35 user nova-compute[73068]:     </nova:instance>
Aug 26 12:00:35 user nova-compute[73068]:   </metadata>
Aug 26 12:00:35 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:00:35 user nova-compute[73068]:     <system>
Aug 26 12:00:35 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:00:35 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:00:35 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:00:35 user nova-compute[73068]:       <entry name="serial">8bd308c4-54d4-4883-bf71-9e7c60f79b51</entry>
Aug 26 12:00:35 user nova-compute[73068]:       <entry name="uuid">8bd308c4-54d4-4883-bf71-9e7c60f79b51</entry>
Aug 26 12:00:35 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:00:35 user nova-compute[73068]:     </system>
Aug 26 12:00:35 user nova-compute[73068]:   </sysinfo>
Aug 26 12:00:35 user nova-compute[73068]:   <os>
Aug 26 12:00:35 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:00:35 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:00:35 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:00:35 user nova-compute[73068]:   </os>
Aug 26 12:00:35 user nova-compute[73068]:   <features>
Aug 26 12:00:35 user nova-compute[73068]:     <acpi/>
Aug 26 12:00:35 user nova-compute[73068]:     <apic/>
Aug 26 12:00:35 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:00:35 user nova-compute[73068]:   </features>
Aug 26 12:00:35 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:00:35 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:00:35 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:00:35 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:00:35 user nova-compute[73068]:   </clock>
Aug 26 12:00:35 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:00:35 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:00:35 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:00:35 user nova-compute[73068]:   </cpu>
Aug 26 12:00:35 user nova-compute[73068]:   <devices>
Aug 26 12:00:35 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 12:00:35 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:00:35 user nova-compute[73068]:       <source dev="/dev/sdd"/>
Aug 26 12:00:35 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:00:35 user nova-compute[73068]:       <serial>25b88969-11a4-4f67-a156-d59abc039ddc</serial>
Aug 26 12:00:35 user nova-compute[73068]:     </disk>
Aug 26 12:00:35 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:00:35 user nova-compute[73068]:       <mac address="fa:16:3e:3e:68:20"/>
Aug 26 12:00:35 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:00:35 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:00:35 user nova-compute[73068]:       <target dev="tapcd87c374-80"/>
Aug 26 12:00:35 user nova-compute[73068]:     </interface>
Aug 26 12:00:35 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:00:35 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/console.log" append="off"/>
Aug 26 12:00:35 user nova-compute[73068]:     </serial>
Aug 26 12:00:35 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:00:35 user nova-compute[73068]:     <video>
Aug 26 12:00:35 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:00:35 user nova-compute[73068]:     </video>
Aug 26 12:00:35 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:00:35 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:00:35 user nova-compute[73068]:     </rng>
Aug 26 12:00:35 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:00:35 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:00:35 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:00:35 user nova-compute[73068]:     </memballoon>
Aug 26 12:00:35 user nova-compute[73068]:   </devices>
Aug 26 12:00:35 user nova-compute[73068]: </domain>
Aug 26 12:00:35 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-153523745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-153523745',id=41,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-wu1tx9q6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:00:12Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=8bd308c4-54d4-4883-bf71-9e7c60f79b51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:68:20,bridge_name='br-int',has_traffic_filtering=True,id=cd87c374-80d6-476b-99c0-0f1e9e1f960f,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd87c374-80') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG os_vif [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:68:20,bridge_name='br-int',has_traffic_filtering=True,id=cd87c374-80d6-476b-99c0-0f1e9e1f960f,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd87c374-80') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd87c374-80, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd87c374-80, col_values=(('external_ids', {'iface-id': 'cd87c374-80d6-476b-99c0-0f1e9e1f960f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:68:20', 'vm-uuid': '8bd308c4-54d4-4883-bf71-9e7c60f79b51'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:36 user nova-compute[73068]: INFO os_vif [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:68:20,bridge_name='br-int',has_traffic_filtering=True,id=cd87c374-80d6-476b-99c0-0f1e9e1f960f,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd87c374-80')
Aug 26 12:00:36 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:00:36 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Took 0.47 seconds to deallocate network for instance.
Aug 26 12:00:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No VIF found with MAC fa:16:3e:3e:68:20, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:36 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Deleted allocations for instance bb9c655d-7e26-45bd-9e28-a695ca25a69b
Aug 26 12:00:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d12cdeae-6b9a-41f3-8f04-36ad4d7e1949 tempest-TestMinimumBasicScenario-143892643 tempest-TestMinimumBasicScenario-143892643-project-member] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.346s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-2c537510-69b5-4992-9f0c-62374d951894 req-81169e7c-a786-4161-a674-85880c253e01 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2c537510-69b5-4992-9f0c-62374d951894 req-81169e7c-a786-4161-a674-85880c253e01 service nova] Acquiring lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2c537510-69b5-4992-9f0c-62374d951894 req-81169e7c-a786-4161-a674-85880c253e01 service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2c537510-69b5-4992-9f0c-62374d951894 req-81169e7c-a786-4161-a674-85880c253e01 service nova] Lock "bb9c655d-7e26-45bd-9e28-a695ca25a69b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-2c537510-69b5-4992-9f0c-62374d951894 req-81169e7c-a786-4161-a674-85880c253e01 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] No waiting events found dispatching network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:00:36 user nova-compute[73068]: WARNING nova.compute.manager [req-2c537510-69b5-4992-9f0c-62374d951894 req-81169e7c-a786-4161-a674-85880c253e01 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received unexpected event network-vif-plugged-5e4a0bfe-be50-46d7-a4db-56790f1cb09c for instance with vm_state deleted and task_state None.
Aug 26 12:00:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-2c537510-69b5-4992-9f0c-62374d951894 req-81169e7c-a786-4161-a674-85880c253e01 service nova] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Received event network-vif-deleted-5e4a0bfe-be50-46d7-a4db-56790f1cb09c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:00:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1398b99-d4d2-4fc6-9d5e-3872484ca768 req-7109988b-b4c4-448c-8978-36045411f95c service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:00:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1398b99-d4d2-4fc6-9d5e-3872484ca768 req-7109988b-b4c4-448c-8978-36045411f95c service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1398b99-d4d2-4fc6-9d5e-3872484ca768 req-7109988b-b4c4-448c-8978-36045411f95c service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1398b99-d4d2-4fc6-9d5e-3872484ca768 req-7109988b-b4c4-448c-8978-36045411f95c service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1398b99-d4d2-4fc6-9d5e-3872484ca768 req-7109988b-b4c4-448c-8978-36045411f95c service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:00:37 user nova-compute[73068]: WARNING nova.compute.manager [req-d1398b99-d4d2-4fc6-9d5e-3872484ca768 req-7109988b-b4c4-448c-8978-36045411f95c service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received unexpected event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with vm_state building and task_state spawning.
Aug 26 12:00:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051239.5045202, 8bd308c4-54d4-4883-bf71-9e7c60f79b51 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:00:39 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] VM Resumed (Lifecycle Event)
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:00:39 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Instance spawned successfully.
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-0735b428-3218-4ffb-9445-d82cbd7cd1fc req-3f346e6c-4d88-44ce-b16f-8fa0f07c595a service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0735b428-3218-4ffb-9445-d82cbd7cd1fc req-3f346e6c-4d88-44ce-b16f-8fa0f07c595a service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0735b428-3218-4ffb-9445-d82cbd7cd1fc req-3f346e6c-4d88-44ce-b16f-8fa0f07c595a service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0735b428-3218-4ffb-9445-d82cbd7cd1fc req-3f346e6c-4d88-44ce-b16f-8fa0f07c595a service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-0735b428-3218-4ffb-9445-d82cbd7cd1fc req-3f346e6c-4d88-44ce-b16f-8fa0f07c595a service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:00:39 user nova-compute[73068]: WARNING nova.compute.manager [req-0735b428-3218-4ffb-9445-d82cbd7cd1fc req-3f346e6c-4d88-44ce-b16f-8fa0f07c595a service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received unexpected event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with vm_state building and task_state spawning.
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:00:39 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051239.506515, 8bd308c4-54d4-4883-bf71-9e7c60f79b51 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:00:39 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] VM Started (Lifecycle Event)
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:00:39 user nova-compute[73068]: INFO nova.compute.manager [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Took 5.07 seconds to spawn the instance on the hypervisor.
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:00:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:00:39 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:00:39 user nova-compute[73068]: INFO nova.compute.manager [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Took 28.55 seconds to build instance.
Aug 26 12:00:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e1d6b510-8e5e-47e0-a431-6476517c70e3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.658s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:43 user nova-compute[73068]: INFO nova.compute.manager [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Terminating instance
Aug 26 12:00:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-4dd70dee-9e54-419a-96ec-b63e61f4efc6 req-9eda3893-5f68-4d45-8a9d-e141f23ba914 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Received event network-vif-unplugged-19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4dd70dee-9e54-419a-96ec-b63e61f4efc6 req-9eda3893-5f68-4d45-8a9d-e141f23ba914 service nova] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4dd70dee-9e54-419a-96ec-b63e61f4efc6 req-9eda3893-5f68-4d45-8a9d-e141f23ba914 service nova] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4dd70dee-9e54-419a-96ec-b63e61f4efc6 req-9eda3893-5f68-4d45-8a9d-e141f23ba914 service nova] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-4dd70dee-9e54-419a-96ec-b63e61f4efc6 req-9eda3893-5f68-4d45-8a9d-e141f23ba914 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] No waiting events found dispatching network-vif-unplugged-19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-4dd70dee-9e54-419a-96ec-b63e61f4efc6 req-9eda3893-5f68-4d45-8a9d-e141f23ba914 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Received event network-vif-unplugged-19513704-e0e6-4e4b-92b4-354893c9fa27 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:00:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Instance destroyed successfully.
Aug 26 12:00:43 user nova-compute[73068]: DEBUG nova.objects.instance [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lazy-loading 'resources' on Instance uuid f024a327-fe6d-4599-9d04-94f7dc54e646 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:56:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-423534747',display_name='tempest-TestServerVolumeAttachmentScenario-server-423534747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-423534747',id=38,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt/+AZqFyTSvkSiVxRGy0fF6xcJoYXHfR2HZE2544E4JaubhI5ZP/LqR9Ay/Pympir4ypCxVrOs6leaZs60JKnoWeySEZ6d0xtt5FnEAqMYkKnXKhdsfLqTHNZ8UCImAA==',key_name='tempest-keypair-1912900491',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:56:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='acb7739d15924faba2b87a6929e91009',ramdisk_id='',reservation_id='r-q1f0536l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-874220908',owner_user_name='tempest-TestServerVolumeAttachmentScenario-874220908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:56:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ac10e83704b4b6e95d66739f6aab12b',uuid=f024a327-fe6d-4599-9d04-94f7dc54e646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19513704-e0e6-4e4b-92b4-354893c9fa27", "address": "fa:16:3e:a6:4b:b1", "network": {"id": "983a876f-5f9d-4528-aed3-d3d03297deb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518423548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acb7739d15924faba2b87a6929e91009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19513704-e0", "ovs_interfaceid": "19513704-e0e6-4e4b-92b4-354893c9fa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Converting VIF {"id": "19513704-e0e6-4e4b-92b4-354893c9fa27", "address": "fa:16:3e:a6:4b:b1", "network": {"id": "983a876f-5f9d-4528-aed3-d3d03297deb4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-518423548-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "acb7739d15924faba2b87a6929e91009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19513704-e0", "ovs_interfaceid": "19513704-e0e6-4e4b-92b4-354893c9fa27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:4b:b1,bridge_name='br-int',has_traffic_filtering=True,id=19513704-e0e6-4e4b-92b4-354893c9fa27,network=Network(983a876f-5f9d-4528-aed3-d3d03297deb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19513704-e0') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG os_vif [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:4b:b1,bridge_name='br-int',has_traffic_filtering=True,id=19513704-e0e6-4e4b-92b4-354893c9fa27,network=Network(983a876f-5f9d-4528-aed3-d3d03297deb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19513704-e0') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19513704-e0, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:43 user nova-compute[73068]: INFO os_vif [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:4b:b1,bridge_name='br-int',has_traffic_filtering=True,id=19513704-e0e6-4e4b-92b4-354893c9fa27,network=Network(983a876f-5f9d-4528-aed3-d3d03297deb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19513704-e0')
Aug 26 12:00:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Deleting instance files /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646_del
Aug 26 12:00:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Deletion of /opt/stack/data/nova/instances/f024a327-fe6d-4599-9d04-94f7dc54e646_del complete
Aug 26 12:00:43 user nova-compute[73068]: INFO nova.compute.manager [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 12:00:43 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:00:43 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:00:45 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:00:45 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Took 1.26 seconds to deallocate network for instance.
Aug 26 12:00:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:45 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:00:45 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:00:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:45 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Deleted allocations for instance f024a327-fe6d-4599-9d04-94f7dc54e646
Aug 26 12:00:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-687a69ea-9479-46cb-b82f-1129cbcab421 req-aae8b3aa-5ff1-4819-acd9-5309ed697fb6 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Received event network-vif-plugged-19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:00:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-687a69ea-9479-46cb-b82f-1129cbcab421 req-aae8b3aa-5ff1-4819-acd9-5309ed697fb6 service nova] Acquiring lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:00:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-687a69ea-9479-46cb-b82f-1129cbcab421 req-aae8b3aa-5ff1-4819-acd9-5309ed697fb6 service nova] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:00:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-687a69ea-9479-46cb-b82f-1129cbcab421 req-aae8b3aa-5ff1-4819-acd9-5309ed697fb6 service nova] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-687a69ea-9479-46cb-b82f-1129cbcab421 req-aae8b3aa-5ff1-4819-acd9-5309ed697fb6 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] No waiting events found dispatching network-vif-plugged-19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:00:45 user nova-compute[73068]: WARNING nova.compute.manager [req-687a69ea-9479-46cb-b82f-1129cbcab421 req-aae8b3aa-5ff1-4819-acd9-5309ed697fb6 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Received unexpected event network-vif-plugged-19513704-e0e6-4e4b-92b4-354893c9fa27 for instance with vm_state deleted and task_state None.
Aug 26 12:00:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-687a69ea-9479-46cb-b82f-1129cbcab421 req-aae8b3aa-5ff1-4819-acd9-5309ed697fb6 service nova] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Received event network-vif-deleted-19513704-e0e6-4e4b-92b4-354893c9fa27 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:00:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-cd55aa4d-ce49-4b8f-a914-9660dd50af16 tempest-TestServerVolumeAttachmentScenario-874220908 tempest-TestServerVolumeAttachmentScenario-874220908-project-member] Lock "f024a327-fe6d-4599-9d04-94f7dc54e646" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.631s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:00:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:50 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051235.427569, bb9c655d-7e26-45bd-9e28-a695ca25a69b => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:00:50 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] VM Stopped (Lifecycle Event)
Aug 26 12:00:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8c1f6801-3bb6-4879-b10e-46f12316583b None None] [instance: bb9c655d-7e26-45bd-9e28-a695ca25a69b] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:00:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:00:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:00:58 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051243.88624, f024a327-fe6d-4599-9d04-94f7dc54e646 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:00:58 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] VM Stopped (Lifecycle Event)
Aug 26 12:00:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ef1e4c79-8aa6-4c8e-b2b3-a31f4acca9ac None None] [instance: f024a327-fe6d-4599-9d04-94f7dc54e646] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:00:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:01:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:01:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:01:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:01:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:01:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:01:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:01:07 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:01:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:01:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:01:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:01:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:01:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:01:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:01:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:01:09 user nova-compute[73068]: INFO nova.compute.manager [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Terminating instance
Aug 26 12:01:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG nova.compute.manager [req-f632e2fa-3d5a-49b2-bbed-e33f8842e4af req-b294573c-ef7e-4687-af15-4002569f1c0a service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-vif-unplugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f632e2fa-3d5a-49b2-bbed-e33f8842e4af req-b294573c-ef7e-4687-af15-4002569f1c0a service nova] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f632e2fa-3d5a-49b2-bbed-e33f8842e4af req-b294573c-ef7e-4687-af15-4002569f1c0a service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f632e2fa-3d5a-49b2-bbed-e33f8842e4af req-b294573c-ef7e-4687-af15-4002569f1c0a service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG nova.compute.manager [req-f632e2fa-3d5a-49b2-bbed-e33f8842e4af req-b294573c-ef7e-4687-af15-4002569f1c0a service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] No waiting events found dispatching network-vif-unplugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG nova.compute.manager [req-f632e2fa-3d5a-49b2-bbed-e33f8842e4af req-b294573c-ef7e-4687-af15-4002569f1c0a service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-vif-unplugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:01:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:01:10 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:01:10 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8140MB free_disk=25.119319915771484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:01:10 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Instance destroyed successfully.
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'resources' on Instance uuid 1af1b911-507d-4303-bf15-b0ebc8b86665 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1905538226',display_name='tempest-ServerActionsTestOtherA-server-1905538226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1905538226',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEidFbMuWm3Ff85RQNGqsibmn5TiGb1b1MKD1SbY+915mQ5QKEZYxmDBFmRdORKitoTVm8qIYWV2p9ti1GszyrhsioU3qq34YTLHcZIRxComRJG1yG+FKs8AGlXLqDxQ4Q==',key_name='tempest-keypair-1757051288',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-f38l2awy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:58:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=1af1b911-507d-4303-bf15-b0ebc8b86665,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "address": "fa:16:3e:00:2b:89", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3b234c-89", "ovs_interfaceid": "8d3b234c-893e-43c5-97f2-48ec745d9fb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_vif [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d3b234c-89, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:10 user nova-compute[73068]: INFO os_vif [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:2b:89,bridge_name='br-int',has_traffic_filtering=True,id=8d3b234c-893e-43c5-97f2-48ec745d9fb5,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d3b234c-89')
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UcQIOspx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:01:10 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a273a8-30de-41fb-ab6f-e716d04fa7d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f797389-4a8a-4a57-9c99-c8e7e295d533]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:01:10 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 12:01:10 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:01:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:01:10 user nova-compute[73068]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 (non-flash)
Aug 26 12:01:10 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:01:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb059e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance a11f0d98-3177-4345-8d54-b76b8a348f21 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 1af1b911-507d-4303-bf15-b0ebc8b86665 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance b148f5b5-ada4-49a6-9e9c-cd04283223ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8bd308c4-54d4-4883-bf71-9e7c60f79b51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7924c777-6dc3-4319-bf20-fd6c74ab5882]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61d944c-469d-46e5-82fa-04411e9636d9]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c899ff-3534-4005-ab87-761e37275fc9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06a9d35-b17b-49bd-b965-77843e874829]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1109932-7316-4917-a419-78011ee3ef8d]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[632c1209-0173-40ab-b45d-abce1f7076a0]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260]
Aug 26 12:01:10 user nova-compute[73068]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46, portal: 172.16.0.220,3260] successful.
Aug 26 12:01:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b6070-2770-42a3-b136-2ba3c2260387]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] <== disconnect_volume: return (280ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:01:10 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Deleting instance files /opt/stack/data/nova/instances/1af1b911-507d-4303-bf15-b0ebc8b86665_del
Aug 26 12:01:10 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Deletion of /opt/stack/data/nova/instances/1af1b911-507d-4303-bf15-b0ebc8b86665_del complete
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:01:10 user nova-compute[73068]: INFO nova.compute.manager [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 26 12:01:10 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:01:10 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:01:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:11 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:01:11 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Took 0.83 seconds to deallocate network for instance.
Aug 26 12:01:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:01:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:01:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 12:01:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-208f163f-3fa6-434e-86f2-8e4ba11e9a26 req-473382c0-224d-43bc-9f92-63efed555797 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:01:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-208f163f-3fa6-434e-86f2-8e4ba11e9a26 req-473382c0-224d-43bc-9f92-63efed555797 service nova] Acquiring lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:01:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-208f163f-3fa6-434e-86f2-8e4ba11e9a26 req-473382c0-224d-43bc-9f92-63efed555797 service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:01:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-208f163f-3fa6-434e-86f2-8e4ba11e9a26 req-473382c0-224d-43bc-9f92-63efed555797 service nova] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:01:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-208f163f-3fa6-434e-86f2-8e4ba11e9a26 req-473382c0-224d-43bc-9f92-63efed555797 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] No waiting events found dispatching network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:01:11 user nova-compute[73068]: WARNING nova.compute.manager [req-208f163f-3fa6-434e-86f2-8e4ba11e9a26 req-473382c0-224d-43bc-9f92-63efed555797 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received unexpected event network-vif-plugged-8d3b234c-893e-43c5-97f2-48ec745d9fb5 for instance with vm_state active and task_state deleting.
Aug 26 12:01:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-208f163f-3fa6-434e-86f2-8e4ba11e9a26 req-473382c0-224d-43bc-9f92-63efed555797 service nova] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Received event network-vif-deleted-8d3b234c-893e-43c5-97f2-48ec745d9fb5 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:01:12 user nova-compute[73068]: INFO nova.compute.manager [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Took 0.77 seconds to detach 1 volumes for instance.
Aug 26 12:01:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Deleting volume: d1c371cd-af08-4bf5-afc2-3a3ad3e0bf46 {{(pid=73068) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 12:01:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:01:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:01:12 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:01:12 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:01:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:01:12 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Deleted allocations for instance 1af1b911-507d-4303-bf15-b0ebc8b86665
Aug 26 12:01:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d9e1dde8-443d-4ced-834e-414a0ba37ed2 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "1af1b911-507d-4303-bf15-b0ebc8b86665" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.451s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:01:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:22 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:01:25 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051270.328824, 1af1b911-507d-4303-bf15-b0ebc8b86665 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:01:25 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] VM Stopped (Lifecycle Event)
Aug 26 12:01:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-2dd84ab0-a6ce-40b4-9d45-b13e75dc1f77 None None] [instance: 1af1b911-507d-4303-bf15-b0ebc8b86665] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:01:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:01:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:01:50 user nova-compute[73068]: INFO nova.compute.manager [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Unshelving
Aug 26 12:01:50 user nova-compute[73068]: INFO nova.virt.block_device [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Booting with volume 24605550-f83a-422e-98d1-831df5da04a3 at /dev/vda
Aug 26 12:01:50 user nova-compute[73068]: DEBUG os_brick.utils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb283a9-261c-4bca-b740-f0df626745e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d9891-0623-4dd0-b6bd-e01bf35c3096]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[078ac0fc-6c47-4ec9-b583-68fa1e43d52e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d151fe2-f81f-48be-ba01-6e5bd6e92220]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:01:50 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:01:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de139b8-d2c4-4f90-816d-0ce9f1044b68]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG os_brick.utils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:01:50 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating existing volume attachment record: e3a2f419-f29c-4abb-8ed7-031d22e03cae {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:01:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:01:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:02:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:02:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:02:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:02:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:02 user nova-compute[73068]: INFO nova.compute.manager [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Rescuing
Aug 26 12:02:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:02:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquired lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:02:02 user nova-compute[73068]: DEBUG nova.network.neutron [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:02:02 user nova-compute[73068]: DEBUG nova.network.neutron [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Updating instance_info_cache with network_info: [{"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:02:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Releasing lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:02:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG nova.compute.manager [req-3c042137-5b8b-4219-9376-60ef2875ab01 req-e1dac4fb-c36f-48a9-adc9-196c42f07b8b service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-unplugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3c042137-5b8b-4219-9376-60ef2875ab01 req-e1dac4fb-c36f-48a9-adc9-196c42f07b8b service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3c042137-5b8b-4219-9376-60ef2875ab01 req-e1dac4fb-c36f-48a9-adc9-196c42f07b8b service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3c042137-5b8b-4219-9376-60ef2875ab01 req-e1dac4fb-c36f-48a9-adc9-196c42f07b8b service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG nova.compute.manager [req-3c042137-5b8b-4219-9376-60ef2875ab01 req-e1dac4fb-c36f-48a9-adc9-196c42f07b8b service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-unplugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:02:03 user nova-compute[73068]: WARNING nova.compute.manager [req-3c042137-5b8b-4219-9376-60ef2875ab01 req-e1dac4fb-c36f-48a9-adc9-196c42f07b8b service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received unexpected event network-vif-unplugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with vm_state active and task_state rescuing.
Aug 26 12:02:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:03 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Instance destroyed successfully.
Aug 26 12:02:03 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Attempting a stable device rescue
Aug 26 12:02:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73068) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Instance directory exists: not creating {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 12:02:03 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Creating image(s)
Aug 26 12:02:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "/opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "/opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG nova.objects.instance [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8bd308c4-54d4-4883-bf71-9e7c60f79b51 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "b3c025982092057f13b03008714db438744d3005" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "b3c025982092057f13b03008714db438744d3005" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005.part --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005.part --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:04 user nova-compute[73068]: DEBUG nova.virt.images [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] 5be77e95-5076-40a8-a32d-52c12fdcea48 was qcow2, converting to raw {{(pid=73068) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 12:02:04 user nova-compute[73068]: DEBUG nova.privsep.utils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73068) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 12:02:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005.part /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005.converted {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG nova.compute.manager [req-69e8178b-5890-483f-a5c4-3caca2eb7675 req-0ff00b88-c6e1-4561-a384-2576fabcd449 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-69e8178b-5890-483f-a5c4-3caca2eb7675 req-0ff00b88-c6e1-4561-a384-2576fabcd449 service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-69e8178b-5890-483f-a5c4-3caca2eb7675 req-0ff00b88-c6e1-4561-a384-2576fabcd449 service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-69e8178b-5890-483f-a5c4-3caca2eb7675 req-0ff00b88-c6e1-4561-a384-2576fabcd449 service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG nova.compute.manager [req-69e8178b-5890-483f-a5c4-3caca2eb7675 req-0ff00b88-c6e1-4561-a384-2576fabcd449 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:02:05 user nova-compute[73068]: WARNING nova.compute.manager [req-69e8178b-5890-483f-a5c4-3caca2eb7675 req-0ff00b88-c6e1-4561-a384-2576fabcd449 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received unexpected event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with vm_state active and task_state rescuing.
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005.part /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005.converted" returned: 0 in 0.765s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005.converted --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "b3c025982092057f13b03008714db438744d3005" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.221s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "b3c025982092057f13b03008714db438744d3005" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "b3c025982092057f13b03008714db438744d3005" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005 --force-share --output=json" returned: 0 in 0.202s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005,backing_fmt=raw /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.rescue {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005,backing_fmt=raw /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.rescue" returned: 0 in 0.052s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "b3c025982092057f13b03008714db438744d3005" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.objects.instance [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'migration_context' on Instance uuid 8bd308c4-54d4-4883-bf71-9e7c60f79b51 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.objects.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Object Instance<8bd308c4-54d4-4883-bf71-9e7c60f79b51> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Start _get_guest_xml network_info=[{"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "vif_mac": "fa:16:3e:3e:68:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5be77e95-5076-40a8-a32d-52c12fdcea48', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '3d01c763-8829-4e8f-8b79-401fa5e618a3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOumRbPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '8bd308c4-54d4-4883-bf71-9e7c60f79b51', 'attached_at': '', 'detached_at': '', 'volume_id': '25b88969-11a4-4f67-a156-d59abc039ddc', 'serial': '25b88969-11a4-4f67-a156-d59abc039ddc'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.objects.instance [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'resources' on Instance uuid 8bd308c4-54d4-4883-bf71-9e7c60f79b51 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.objects.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Object Instance<8bd308c4-54d4-4883-bf71-9e7c60f79b51> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.objects.instance [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'numa_topology' on Instance uuid 8bd308c4-54d4-4883-bf71-9e7c60f79b51 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.objects.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Object Instance<8bd308c4-54d4-4883-bf71-9e7c60f79b51> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:02:06 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:02:06 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.objects.instance [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8bd308c4-54d4-4883-bf71-9e7c60f79b51 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.objects.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Object Instance<8bd308c4-54d4-4883-bf71-9e7c60f79b51> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOumRbPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:02:06 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:02:06 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:02:06 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2737175a-af23-445b-b9b3-d57b47423ffe]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = aOumRbPH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 12:02:06 user nova-compute[73068]: node.name = iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc
Aug 26 12:02:06 user nova-compute[73068]: node.tpgt = -1
Aug 26 12:02:06 user nova-compute[73068]: node.startup = automatic
Aug 26 12:02:06 user nova-compute[73068]: node.leading_login = No
Aug 26 12:02:06 user nova-compute[73068]: iface.iscsi_ifacename = default
Aug 26 12:02:06 user nova-compute[73068]: iface.net_ifacename = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.ipaddress = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.prefix_len = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.hwaddress = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.transport_name = tcp
Aug 26 12:02:06 user nova-compute[73068]: iface.initiatorname = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.state = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.vlan_id = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.vlan_priority = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.vlan_state = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.iface_num = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.mtu = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.port = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.bootproto = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.subnet_mask = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.gateway = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.dhcp_alt_client_id = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.dhcp_dns = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.dhcp_learn_iqn = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.dhcp_vendor_id_state = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.dhcp_vendor_id = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.dhcp_slp_da = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.fragmentation = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.gratuitous_arp = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.incoming_forwarding = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.tos_state = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.tos = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.ttl = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.delayed_ack = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.tcp_nagle = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.tcp_wsf_state = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.tcp_wsf = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.tcp_timer_scale = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.tcp_timestamp = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.redirect = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.def_task_mgmt_timeout = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.header_digest = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.data_digest = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.immediate_data = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.initial_r2t = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.data_seq_inorder = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.data_pdu_inorder = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.erl = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.max_receive_data_len = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.first_burst_len = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.max_outstanding_r2t = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.max_burst_len = 0
Aug 26 12:02:06 user nova-compute[73068]: iface.chap_auth = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.bidi_chap = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.strict_login_compliance = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.discovery_auth = <empty>
Aug 26 12:02:06 user nova-compute[73068]: iface.discovery_logout = <empty>
Aug 26 12:02:06 user nova-compute[73068]: node.discovery_address = <empty>
Aug 26 12:02:06 user nova-compute[73068]: node.discovery_port = 0
Aug 26 12:02:06 user nova-compute[73068]: node.discovery_type = static
Aug 26 12:02:06 user nova-compute[73068]: node.session.initial_cmdsn = 0
Aug 26 12:02:06 user nova-compute[73068]: node.session.initial_login_retry_max = 8
Aug 26 12:02:06 user nova-compute[73068]: node.session.xmit_thread_priority = -20
Aug 26 12:02:06 user nova-compute[73068]: node.session.cmds_max = 128
Aug 26 12:02:06 user nova-compute[73068]: node.session.queue_depth = 32
Aug 26 12:02:06 user nova-compute[73068]: node.session.nr_sessions = 1
Aug 26 12:02:06 user nova-compute[73068]: node.session.auth.authmethod = CHAP
Aug 26 12:02:06 user nova-compute[73068]: node.session.auth.username = aOumRbPH
Aug 26 12:02:06 user nova-compute[73068]: node.session.auth.password = ***
Aug 26 12:02:06 user nova-compute[73068]: node.session.auth.username_in = <empty>
Aug 26 12:02:06 user nova-compute[73068]: node.session.auth.password_in = <empty>
Aug 26 12:02:06 user nova-compute[73068]: node.session.auth.chap_algs = MD5
Aug 26 12:02:06 user nova-compute[73068]: node.session.timeo.replacement_timeout = 120
Aug 26 12:02:06 user nova-compute[73068]: node.session.err_timeo.abort_timeout = 15
Aug 26 12:02:06 user nova-compute[73068]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 12:02:06 user nova-compute[73068]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 12:02:06 user nova-compute[73068]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 12:02:06 user nova-compute[73068]: node.session.iscsi.FastAbort = Yes
Aug 26 12:02:06 user nova-compute[73068]: node.session.iscsi.InitialR2T = No
Aug 26 12:02:06 user nova-compute[73068]: node.session.iscsi.ImmediateData = Yes
Aug 26 12:02:06 user nova-compute[73068]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 12:02:06 user nova-compute[73068]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 12:02:06 user nova-compute[73068]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 12:02:06 user nova-compute[73068]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 12:02:06 user nova-compute[73068]: node.session.iscsi.MaxConnections = 1
Aug 26 12:02:06 user nova-compute[73068]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 12:02:06 user nova-compute[73068]: node.session.iscsi.ERL = 0
Aug 26 12:02:06 user nova-compute[73068]: node.session.scan = manual
Aug 26 12:02:06 user nova-compute[73068]: node.session.reopen_max = 0
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].address = 172.16.0.220
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].port = 3260
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].startup = manual
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].tcp.window_size = 524288
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].tcp.type_of_service = 0
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].timeo.logout_timeout = 15
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].timeo.login_timeout = 15
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].timeo.auth_timeout = 45
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].iscsi.DataDigest = None
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].iscsi.IFMarker = No
Aug 26 12:02:06 user nova-compute[73068]: node.conn[0].iscsi.OFMarker = No
Aug 26 12:02:06 user nova-compute[73068]: # END RECORD
Aug 26 12:02:06 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e3f38f-1a56-457a-b18e-cb90ea316ecb]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[207631c6-c09e-49a1-b393-dac156a354a6]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aOumRbPH {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aOumRbPH" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c81e277-7642-462b-bcf9-862491c3c2db]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aOumRbPH'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f67efed-aa8d-485b-87a2-7a350c72d184]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8370b8-3e62-47d7-af5b-73c2cdce34ea]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:02:06 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:02:06 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:02:06 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:02:06 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.139s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] HCTL ('35', '0', '0', 0) found on session 45 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a10888-7694-450a-8b37-3b19d441c846]: (4, ('0 0 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Searching for a device in session 45 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOumRbPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.162s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] <== connect_volume: return (164ms) {'type': 'block', 'scsi_wwn': '23433643830326364', 'path': '/dev/sdd'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433643830326364', 'path': '/dev/sdd'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-153523745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-153523745',id=41,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:00:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-wu1tx9q6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:00:40Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=8bd308c4-54d4-4883-bf71-9e7c60f79b51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "vif_mac": "fa:16:3e:3e:68:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "vif_mac": "fa:16:3e:3e:68:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:68:20,bridge_name='br-int',has_traffic_filtering=True,id=cd87c374-80d6-476b-99c0-0f1e9e1f960f,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd87c374-80') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.objects.instance [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bd308c4-54d4-4883-bf71-9e7c60f79b51 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.objects.base [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Object Instance<8bd308c4-54d4-4883-bf71-9e7c60f79b51> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:02:06 user nova-compute[73068]:   <uuid>8bd308c4-54d4-4883-bf71-9e7c60f79b51</uuid>
Aug 26 12:02:06 user nova-compute[73068]:   <name>instance-00000029</name>
Aug 26 12:02:06 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:02:06 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:02:06 user nova-compute[73068]:   <metadata>
Aug 26 12:02:06 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:02:06 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:02:06 user nova-compute[73068]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-153523745</nova:name>
Aug 26 12:02:06 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:02:06</nova:creationTime>
Aug 26 12:02:06 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:02:06 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:02:06 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:02:06 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:02:06 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:02:06 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:02:06 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:02:06 user nova-compute[73068]:       <nova:owner>
Aug 26 12:02:06 user nova-compute[73068]:         <nova:user uuid="9cd2bf96810a4540969277c8f94d5a6d">tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member</nova:user>
Aug 26 12:02:06 user nova-compute[73068]:         <nova:project uuid="d20a527043d44250bfe0a4b9dbf3e00d">tempest-ServerBootFromVolumeStableRescueTest-343541457</nova:project>
Aug 26 12:02:06 user nova-compute[73068]:       </nova:owner>
Aug 26 12:02:06 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 12:02:06 user nova-compute[73068]:       <nova:ports>
Aug 26 12:02:06 user nova-compute[73068]:         <nova:port uuid="cd87c374-80d6-476b-99c0-0f1e9e1f960f">
Aug 26 12:02:06 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 12:02:06 user nova-compute[73068]:         </nova:port>
Aug 26 12:02:06 user nova-compute[73068]:       </nova:ports>
Aug 26 12:02:06 user nova-compute[73068]:     </nova:instance>
Aug 26 12:02:06 user nova-compute[73068]:   </metadata>
Aug 26 12:02:06 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:02:06 user nova-compute[73068]:     <system>
Aug 26 12:02:06 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:02:06 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:02:06 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:02:06 user nova-compute[73068]:       <entry name="serial">8bd308c4-54d4-4883-bf71-9e7c60f79b51</entry>
Aug 26 12:02:06 user nova-compute[73068]:       <entry name="uuid">8bd308c4-54d4-4883-bf71-9e7c60f79b51</entry>
Aug 26 12:02:06 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:02:06 user nova-compute[73068]:     </system>
Aug 26 12:02:06 user nova-compute[73068]:   </sysinfo>
Aug 26 12:02:06 user nova-compute[73068]:   <os>
Aug 26 12:02:06 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:02:06 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:02:06 user nova-compute[73068]:   </os>
Aug 26 12:02:06 user nova-compute[73068]:   <features>
Aug 26 12:02:06 user nova-compute[73068]:     <acpi/>
Aug 26 12:02:06 user nova-compute[73068]:     <apic/>
Aug 26 12:02:06 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:02:06 user nova-compute[73068]:   </features>
Aug 26 12:02:06 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:02:06 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:02:06 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:02:06 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:02:06 user nova-compute[73068]:   </clock>
Aug 26 12:02:06 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:02:06 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:02:06 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:02:06 user nova-compute[73068]:   </cpu>
Aug 26 12:02:06 user nova-compute[73068]:   <devices>
Aug 26 12:02:06 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 12:02:06 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:02:06 user nova-compute[73068]:       <source dev="/dev/sdd"/>
Aug 26 12:02:06 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:02:06 user nova-compute[73068]:       <serial>25b88969-11a4-4f67-a156-d59abc039ddc</serial>
Aug 26 12:02:06 user nova-compute[73068]:     </disk>
Aug 26 12:02:06 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:02:06 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:02:06 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.rescue"/>
Aug 26 12:02:06 user nova-compute[73068]:       <target dev="vdb" bus="virtio"/>
Aug 26 12:02:06 user nova-compute[73068]:       <boot order="1"/>
Aug 26 12:02:06 user nova-compute[73068]:     </disk>
Aug 26 12:02:06 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:02:06 user nova-compute[73068]:       <mac address="fa:16:3e:3e:68:20"/>
Aug 26 12:02:06 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:02:06 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:02:06 user nova-compute[73068]:       <target dev="tapcd87c374-80"/>
Aug 26 12:02:06 user nova-compute[73068]:     </interface>
Aug 26 12:02:06 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:02:06 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/console.log" append="off"/>
Aug 26 12:02:06 user nova-compute[73068]:     </serial>
Aug 26 12:02:06 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:02:06 user nova-compute[73068]:     <video>
Aug 26 12:02:06 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:02:06 user nova-compute[73068]:     </video>
Aug 26 12:02:06 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:02:06 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:02:06 user nova-compute[73068]:     </rng>
Aug 26 12:02:06 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:02:06 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:02:06 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:02:06 user nova-compute[73068]:     </memballoon>
Aug 26 12:02:06 user nova-compute[73068]:   </devices>
Aug 26 12:02:06 user nova-compute[73068]: </domain>
Aug 26 12:02:06 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:02:06 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Instance destroyed successfully.
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:02:06 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] No VIF found with MAC fa:16:3e:3e:68:20, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:02:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-198ef7ba-b784-44fd-b093-e70e9814a98a req-bf26e1e4-c166-4f1c-809d-fb2d2f122cb0 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-198ef7ba-b784-44fd-b093-e70e9814a98a req-bf26e1e4-c166-4f1c-809d-fb2d2f122cb0 service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-198ef7ba-b784-44fd-b093-e70e9814a98a req-bf26e1e4-c166-4f1c-809d-fb2d2f122cb0 service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-198ef7ba-b784-44fd-b093-e70e9814a98a req-bf26e1e4-c166-4f1c-809d-fb2d2f122cb0 service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-198ef7ba-b784-44fd-b093-e70e9814a98a req-bf26e1e4-c166-4f1c-809d-fb2d2f122cb0 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:02:08 user nova-compute[73068]: WARNING nova.compute.manager [req-198ef7ba-b784-44fd-b093-e70e9814a98a req-bf26e1e4-c166-4f1c-809d-fb2d2f122cb0 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received unexpected event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with vm_state active and task_state rescuing.
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "a11f0d98-3177-4345-8d54-b76b8a348f21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:08 user nova-compute[73068]: INFO nova.compute.manager [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Terminating instance
Aug 26 12:02:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-2a83f023-784d-4575-9a09-64ad0c705cf3 req-898f6b4d-2b7a-44c2-ba59-8b9c13f69522 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received event network-vif-unplugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2a83f023-784d-4575-9a09-64ad0c705cf3 req-898f6b4d-2b7a-44c2-ba59-8b9c13f69522 service nova] Acquiring lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2a83f023-784d-4575-9a09-64ad0c705cf3 req-898f6b4d-2b7a-44c2-ba59-8b9c13f69522 service nova] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2a83f023-784d-4575-9a09-64ad0c705cf3 req-898f6b4d-2b7a-44c2-ba59-8b9c13f69522 service nova] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-2a83f023-784d-4575-9a09-64ad0c705cf3 req-898f6b4d-2b7a-44c2-ba59-8b9c13f69522 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] No waiting events found dispatching network-vif-unplugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-2a83f023-784d-4575-9a09-64ad0c705cf3 req-898f6b4d-2b7a-44c2-ba59-8b9c13f69522 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received event network-vif-unplugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:02:08 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Instance destroyed successfully.
Aug 26 12:02:08 user nova-compute[73068]: DEBUG nova.objects.instance [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lazy-loading 'resources' on Instance uuid a11f0d98-3177-4345-8d54-b76b8a348f21 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-24310409',display_name='tempest-ServerActionsTestOtherA-server-24310409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-24310409',id=19,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEidFbMuWm3Ff85RQNGqsibmn5TiGb1b1MKD1SbY+915mQ5QKEZYxmDBFmRdORKitoTVm8qIYWV2p9ti1GszyrhsioU3qq34YTLHcZIRxComRJG1yG+FKs8AGlXLqDxQ4Q==',key_name='tempest-keypair-1757051288',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:43:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b517fdd290f5457f99b6cc9423a809b5',ramdisk_id='',reservation_id='r-84j8njnv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-281587706',owner_user_name='tempest-ServerActionsTestOtherA-281587706-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:43:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dbdaab1cbb4446b8709fe4526c10317',uuid=a11f0d98-3177-4345-8d54-b76b8a348f21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converting VIF {"id": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "address": "fa:16:3e:76:6e:44", "network": {"id": "3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1205273074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b517fdd290f5457f99b6cc9423a809b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9e1cc41-b6", "ovs_interfaceid": "f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e1cc41-b6') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG os_vif [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e1cc41-b6') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9e1cc41-b6, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:02:08 user nova-compute[73068]: INFO os_vif [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:6e:44,bridge_name='br-int',has_traffic_filtering=True,id=f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111,network=Network(3e0e5e23-f8e7-4543-bbc3-ff1d61d4b28e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9e1cc41-b6')
Aug 26 12:02:08 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Deleting instance files /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21_del
Aug 26 12:02:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Deletion of /opt/stack/data/nova/instances/a11f0d98-3177-4345-8d54-b76b8a348f21_del complete
Aug 26 12:02:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:02:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:09 user nova-compute[73068]: INFO nova.compute.manager [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 26 12:02:09 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:02:09 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:02:09 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:02:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:09 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Error from libvirt while getting description of instance-00000013: [Error Code 42] Domain not found: no domain with matching uuid 'a11f0d98-3177-4345-8d54-b76b8a348f21' (instance-00000013): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a11f0d98-3177-4345-8d54-b76b8a348f21' (instance-00000013)
Aug 26 12:02:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-2cdb3d44-8bb4-49cc-aad8-5b564c317667 req-c9356df2-831f-4be6-b665-0e1d4d5fcf13 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received event network-vif-deleted-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:02:10 user nova-compute[73068]: INFO nova.compute.manager [req-2cdb3d44-8bb4-49cc-aad8-5b564c317667 req-c9356df2-831f-4be6-b665-0e1d4d5fcf13 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Neutron deleted interface f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111; detaching it from the instance and deleting it from the info cache
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.network.neutron [req-2cdb3d44-8bb4-49cc-aad8-5b564c317667 req-c9356df2-831f-4be6-b665-0e1d4d5fcf13 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:02:10 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Took 0.76 seconds to deallocate network for instance.
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-2cdb3d44-8bb4-49cc-aad8-5b564c317667 req-c9356df2-831f-4be6-b665-0e1d4d5fcf13 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Detach interface failed, port_id=f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111, reason: Instance a11f0d98-3177-4345-8d54-b76b8a348f21 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-947b88e1-28d5-437e-9551-defd5d78d74e req-2dc6fdf9-6f96-4799-842c-82f274198ebe service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-947b88e1-28d5-437e-9551-defd5d78d74e req-2dc6fdf9-6f96-4799-842c-82f274198ebe service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-947b88e1-28d5-437e-9551-defd5d78d74e req-2dc6fdf9-6f96-4799-842c-82f274198ebe service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-947b88e1-28d5-437e-9551-defd5d78d74e req-2dc6fdf9-6f96-4799-842c-82f274198ebe service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-947b88e1-28d5-437e-9551-defd5d78d74e req-2dc6fdf9-6f96-4799-842c-82f274198ebe service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:02:10 user nova-compute[73068]: WARNING nova.compute.manager [req-947b88e1-28d5-437e-9551-defd5d78d74e req-2dc6fdf9-6f96-4799-842c-82f274198ebe service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received unexpected event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with vm_state active and task_state rescuing.
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-80dc1921-2770-4bda-ad2d-bdb15b143553 req-e8992978-293c-4b02-b035-f9cf4d652c79 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received event network-vif-plugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-80dc1921-2770-4bda-ad2d-bdb15b143553 req-e8992978-293c-4b02-b035-f9cf4d652c79 service nova] Acquiring lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-80dc1921-2770-4bda-ad2d-bdb15b143553 req-e8992978-293c-4b02-b035-f9cf4d652c79 service nova] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-80dc1921-2770-4bda-ad2d-bdb15b143553 req-e8992978-293c-4b02-b035-f9cf4d652c79 service nova] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-80dc1921-2770-4bda-ad2d-bdb15b143553 req-e8992978-293c-4b02-b035-f9cf4d652c79 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] No waiting events found dispatching network-vif-plugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:02:10 user nova-compute[73068]: WARNING nova.compute.manager [req-80dc1921-2770-4bda-ad2d-bdb15b143553 req-e8992978-293c-4b02-b035-f9cf4d652c79 service nova] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Received unexpected event network-vif-plugged-f9e1cc41-b6f9-4ec5-b931-ce0a9b9d7111 for instance with vm_state deleted and task_state None.
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for 8bd308c4-54d4-4883-bf71-9e7c60f79b51 due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051330.587841, 8bd308c4-54d4-4883-bf71-9e7c60f79b51 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:02:10 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] VM Resumed (Lifecycle Event)
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-36f46ba9-aadf-4326-8793-293f15db5d34 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:02:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:02:11 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Deleted allocations for instance a11f0d98-3177-4345-8d54-b76b8a348f21
Aug 26 12:02:11 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051330.5887773, 8bd308c4-54d4-4883-bf71-9e7c60f79b51 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:02:11 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] VM Started (Lifecycle Event)
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:02:11 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:02:11 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8496MB free_disk=25.053577423095703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74d37d12-5f37-4de6-bc25-d4a815b2db84 tempest-ServerActionsTestOtherA-281587706 tempest-ServerActionsTestOtherA-281587706-project-member] Lock "a11f0d98-3177-4345-8d54-b76b8a348f21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.952s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance b148f5b5-ada4-49a6-9e9c-cd04283223ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8bd308c4-54d4-4883-bf71-9e7c60f79b51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 88e1f171-b5e8-4164-a659-69f8fdc653ed has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lazy-loading 'pci_requests' on Instance uuid 88e1f171-b5e8-4164-a659-69f8fdc653ed {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lazy-loading 'numa_topology' on Instance uuid 88e1f171-b5e8-4164-a659-69f8fdc653ed {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:02:11 user nova-compute[73068]: INFO nova.compute.claims [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Claim successful on node user
Aug 26 12:02:12 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:02:12 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:02:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:12 user nova-compute[73068]: INFO nova.network.neutron [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating port fd463838-cf9f-4607-a540-856cf74753d9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 12:02:12 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:02:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:02:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:02:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:02:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:02:12 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:02:12 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 2011f764-7057-43ba-ba00-834376cc968e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:12 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updating instance_info_cache with network_info: [{"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquired lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-25d48c34-cde3-46be-b186-d8db1c511a14 req-4f8d798f-8b0d-45a1-b169-d8f2c950f978 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-changed-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-25d48c34-cde3-46be-b186-d8db1c511a14 req-4f8d798f-8b0d-45a1-b169-d8f2c950f978 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Refreshing instance network info cache due to event network-changed-fd463838-cf9f-4607-a540-856cf74753d9. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-25d48c34-cde3-46be-b186-d8db1c511a14 req-4f8d798f-8b0d-45a1-b169-d8f2c950f978 service nova] Acquiring lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating instance_info_cache with network_info: [{"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Releasing lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:02:13 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Creating image(s)
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Ensure instance console log exists: /opt/stack/data/nova/instances/88e1f171-b5e8-4164-a659-69f8fdc653ed/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Start _get_guest_xml network_info=[{"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'e3a2f419-f29c-4abb-8ed7-031d22e03cae', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Qmktbyxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88e1f171-b5e8-4164-a659-69f8fdc653ed', 'attached_at': '', 'detached_at': '', 'volume_id': '24605550-f83a-422e-98d1-831df5da04a3', 'serial': '24605550-f83a-422e-98d1-831df5da04a3'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-25d48c34-cde3-46be-b186-d8db1c511a14 req-4f8d798f-8b0d-45a1-b169-d8f2c950f978 service nova] Acquired lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.network.neutron [req-25d48c34-cde3-46be-b186-d8db1c511a14 req-4f8d798f-8b0d-45a1-b169-d8f2c950f978 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Refreshing network info cache for port fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:02:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:02:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lazy-loading 'vcpu_model' on Instance uuid 88e1f171-b5e8-4164-a659-69f8fdc653ed {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.objects.base [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Object Instance<88e1f171-b5e8-4164-a659-69f8fdc653ed> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Qmktbyxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:02:13 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:02:13 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:02:13 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[542eea6d-0e4d-4ef3-83ca-88c24402ecdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:02:13 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8a6a2c-a774-46a1-96b9-c83585497cce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3] added
Aug 26 12:02:13 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d86c7bd-1952-470f-81ba-68e662d425ba]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18eebe5-5eeb-4bed-a34c-e057f5d1fe11]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Qmktbyxa {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Qmktbyxa" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d783824-d1fe-4fe6-99a3-dbcdcd92463f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Qmktbyxa'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d538546d-c7cc-4cd0-823b-c23702b554b7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e378df1-9bfb-4a65-b1f1-e5c72742caef]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:02:13 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:02:13 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:02:13 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:02:13 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaadc4b6-5bc8-421b-9e90-bb05126514f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260]
Aug 26 12:02:13 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260] successful.
Aug 26 12:02:13 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1f0141-75bd-4b5c-a865-c89b1794a5bf]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8533c83d-e7a2-49e3-9fbf-1d221e861ca7]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:02:13 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:02:13 user nova-compute[73068]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 12:02:13 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:02:13 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:02:13 user nova-compute[73068]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 12:02:13 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:02:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:02:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:02:14 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3edb8f-c7c6-45aa-b068-5707d9298853]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:02:14 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:02:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Qmktbyxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:02:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-25d48c34-cde3-46be-b186-d8db1c511a14 req-4f8d798f-8b0d-45a1-b169-d8f2c950f978 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updated VIF entry in instance network info cache for port fd463838-cf9f-4607-a540-856cf74753d9. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:02:14 user nova-compute[73068]: DEBUG nova.network.neutron [req-25d48c34-cde3-46be-b186-d8db1c511a14 req-4f8d798f-8b0d-45a1-b169-d8f2c950f978 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating instance_info_cache with network_info: [{"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:02:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-25d48c34-cde3-46be-b186-d8db1c511a14 req-4f8d798f-8b0d-45a1-b169-d8f2c950f978 service nova] Releasing lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23864393664666162', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864393664666162', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1280182601',display_name='tempest-TestShelveInstance-server-1280182601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1280182601',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2008128873',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c4d268fa0703413ca9f163a0891bc202',ramdisk_id='',reservation_id='r-80efw2yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1913379620',owner_user_name='tempest-TestShelveInstance-1913379620-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:01:51Z,user_data=None,user_id='7ee37cf249774afdad5850676ccae88f',uuid=88e1f171-b5e8-4164-a659-69f8fdc653ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converting VIF {"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lazy-loading 'pci_devices' on Instance uuid 88e1f171-b5e8-4164-a659-69f8fdc653ed {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.objects.base [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Object Instance<88e1f171-b5e8-4164-a659-69f8fdc653ed> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:02:15 user nova-compute[73068]:   <uuid>88e1f171-b5e8-4164-a659-69f8fdc653ed</uuid>
Aug 26 12:02:15 user nova-compute[73068]:   <name>instance-00000028</name>
Aug 26 12:02:15 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:02:15 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:02:15 user nova-compute[73068]:   <metadata>
Aug 26 12:02:15 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:02:15 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:02:15 user nova-compute[73068]:       <nova:name>tempest-TestShelveInstance-server-1280182601</nova:name>
Aug 26 12:02:15 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:02:13</nova:creationTime>
Aug 26 12:02:15 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:02:15 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:02:15 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:02:15 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:02:15 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:02:15 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:02:15 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:02:15 user nova-compute[73068]:       <nova:owner>
Aug 26 12:02:15 user nova-compute[73068]:         <nova:user uuid="7ee37cf249774afdad5850676ccae88f">tempest-TestShelveInstance-1913379620-project-member</nova:user>
Aug 26 12:02:15 user nova-compute[73068]:         <nova:project uuid="c4d268fa0703413ca9f163a0891bc202">tempest-TestShelveInstance-1913379620</nova:project>
Aug 26 12:02:15 user nova-compute[73068]:       </nova:owner>
Aug 26 12:02:15 user nova-compute[73068]:       <nova:ports>
Aug 26 12:02:15 user nova-compute[73068]:         <nova:port uuid="fd463838-cf9f-4607-a540-856cf74753d9">
Aug 26 12:02:15 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 12:02:15 user nova-compute[73068]:         </nova:port>
Aug 26 12:02:15 user nova-compute[73068]:       </nova:ports>
Aug 26 12:02:15 user nova-compute[73068]:     </nova:instance>
Aug 26 12:02:15 user nova-compute[73068]:   </metadata>
Aug 26 12:02:15 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:02:15 user nova-compute[73068]:     <system>
Aug 26 12:02:15 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:02:15 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:02:15 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:02:15 user nova-compute[73068]:       <entry name="serial">88e1f171-b5e8-4164-a659-69f8fdc653ed</entry>
Aug 26 12:02:15 user nova-compute[73068]:       <entry name="uuid">88e1f171-b5e8-4164-a659-69f8fdc653ed</entry>
Aug 26 12:02:15 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:02:15 user nova-compute[73068]:     </system>
Aug 26 12:02:15 user nova-compute[73068]:   </sysinfo>
Aug 26 12:02:15 user nova-compute[73068]:   <os>
Aug 26 12:02:15 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:02:15 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:02:15 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:02:15 user nova-compute[73068]:   </os>
Aug 26 12:02:15 user nova-compute[73068]:   <features>
Aug 26 12:02:15 user nova-compute[73068]:     <acpi/>
Aug 26 12:02:15 user nova-compute[73068]:     <apic/>
Aug 26 12:02:15 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:02:15 user nova-compute[73068]:   </features>
Aug 26 12:02:15 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:02:15 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:02:15 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:02:15 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:02:15 user nova-compute[73068]:   </clock>
Aug 26 12:02:15 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:02:15 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:02:15 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:02:15 user nova-compute[73068]:   </cpu>
Aug 26 12:02:15 user nova-compute[73068]:   <devices>
Aug 26 12:02:15 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 12:02:15 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:02:15 user nova-compute[73068]:       <source dev="/dev/sdc"/>
Aug 26 12:02:15 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:02:15 user nova-compute[73068]:       <serial>24605550-f83a-422e-98d1-831df5da04a3</serial>
Aug 26 12:02:15 user nova-compute[73068]:     </disk>
Aug 26 12:02:15 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:02:15 user nova-compute[73068]:       <mac address="fa:16:3e:dd:90:d8"/>
Aug 26 12:02:15 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:02:15 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:02:15 user nova-compute[73068]:       <target dev="tapfd463838-cf"/>
Aug 26 12:02:15 user nova-compute[73068]:     </interface>
Aug 26 12:02:15 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:02:15 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/88e1f171-b5e8-4164-a659-69f8fdc653ed/console.log" append="off"/>
Aug 26 12:02:15 user nova-compute[73068]:     </serial>
Aug 26 12:02:15 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:02:15 user nova-compute[73068]:     <video>
Aug 26 12:02:15 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:02:15 user nova-compute[73068]:     </video>
Aug 26 12:02:15 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:02:15 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:02:15 user nova-compute[73068]:     </rng>
Aug 26 12:02:15 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:02:15 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:02:15 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:02:15 user nova-compute[73068]:     </memballoon>
Aug 26 12:02:15 user nova-compute[73068]:   </devices>
Aug 26 12:02:15 user nova-compute[73068]: </domain>
Aug 26 12:02:15 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1280182601',display_name='tempest-TestShelveInstance-server-1280182601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1280182601',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2008128873',keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c4d268fa0703413ca9f163a0891bc202',ramdisk_id='',reservation_id='r-80efw2yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1913379620',owner_user_name='tempest-TestShelveInstance-1913379620-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:01:51Z,user_data=None,user_id='7ee37cf249774afdad5850676ccae88f',uuid=88e1f171-b5e8-4164-a659-69f8fdc653ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converting VIF {"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG os_vif [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd463838-cf, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd463838-cf, col_values=(('external_ids', {'iface-id': 'fd463838-cf9f-4607-a540-856cf74753d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:90:d8', 'vm-uuid': '88e1f171-b5e8-4164-a659-69f8fdc653ed'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:15 user nova-compute[73068]: INFO os_vif [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf')
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:02:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] No VIF found with MAC fa:16:3e:dd:90:d8, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:02:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-727cb5f9-c750-441c-a4e2-02aba2ad6d32 req-438b9959-e9b0-403f-90d8-2418ecf72c31 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:02:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-727cb5f9-c750-441c-a4e2-02aba2ad6d32 req-438b9959-e9b0-403f-90d8-2418ecf72c31 service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-727cb5f9-c750-441c-a4e2-02aba2ad6d32 req-438b9959-e9b0-403f-90d8-2418ecf72c31 service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-727cb5f9-c750-441c-a4e2-02aba2ad6d32 req-438b9959-e9b0-403f-90d8-2418ecf72c31 service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-727cb5f9-c750-441c-a4e2-02aba2ad6d32 req-438b9959-e9b0-403f-90d8-2418ecf72c31 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:02:16 user nova-compute[73068]: WARNING nova.compute.manager [req-727cb5f9-c750-441c-a4e2-02aba2ad6d32 req-438b9959-e9b0-403f-90d8-2418ecf72c31 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received unexpected event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 12:02:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:18 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051338.564353, 88e1f171-b5e8-4164-a659-69f8fdc653ed => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:02:18 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] VM Resumed (Lifecycle Event)
Aug 26 12:02:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:02:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:02:18 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Instance spawned successfully.
Aug 26 12:02:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:02:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:02:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:02:18 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:02:18 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051338.5673306, 88e1f171-b5e8-4164-a659-69f8fdc653ed => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:02:18 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] VM Started (Lifecycle Event)
Aug 26 12:02:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:02:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:02:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d312b36c-0158-4c1e-a7ef-031058b04031 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.053s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-9633e961-1e87-4392-b1ae-58333fa77b9d req-70d2402a-2889-4b96-b1a8-223d49f92a6e service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:02:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9633e961-1e87-4392-b1ae-58333fa77b9d req-70d2402a-2889-4b96-b1a8-223d49f92a6e service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9633e961-1e87-4392-b1ae-58333fa77b9d req-70d2402a-2889-4b96-b1a8-223d49f92a6e service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9633e961-1e87-4392-b1ae-58333fa77b9d req-70d2402a-2889-4b96-b1a8-223d49f92a6e service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-9633e961-1e87-4392-b1ae-58333fa77b9d req-70d2402a-2889-4b96-b1a8-223d49f92a6e service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:02:18 user nova-compute[73068]: WARNING nova.compute.manager [req-9633e961-1e87-4392-b1ae-58333fa77b9d req-70d2402a-2889-4b96-b1a8-223d49f92a6e service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received unexpected event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with vm_state active and task_state None.
Aug 26 12:02:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:23 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051328.9406908, a11f0d98-3177-4345-8d54-b76b8a348f21 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:02:23 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] VM Stopped (Lifecycle Event)
Aug 26 12:02:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5a3120e4-d18a-4180-8b23-c6cf9d9eb76d None None] [instance: a11f0d98-3177-4345-8d54-b76b8a348f21] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:02:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:51 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:02:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 2011f764-7057-43ba-ba00-834376cc968e {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid ae831c2e-a761-4cda-95ae-9476705baa5e {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid b148f5b5-ada4-49a6-9e9c-cd04283223ee {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 8bd308c4-54d4-4883-bf71-9e7c60f79b51 {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 88e1f171-b5e8-4164-a659-69f8fdc653ed {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "2011f764-7057-43ba-ba00-834376cc968e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "2011f764-7057-43ba-ba00-834376cc968e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "2011f764-7057-43ba-ba00-834376cc968e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:02:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:06 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:03:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:03:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:03:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:03:09 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Updating instance_info_cache with network_info: [{"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-ae831c2e-a761-4cda-95ae-9476705baa5e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:12 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:03:12 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8314MB free_disk=25.06766128540039GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance b148f5b5-ada4-49a6-9e9c-cd04283223ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8bd308c4-54d4-4883-bf71-9e7c60f79b51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 88e1f171-b5e8-4164-a659-69f8fdc653ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.757s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.310s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:12 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:03:12 user nova-compute[73068]: INFO nova.compute.claims [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Claim successful on node user
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:03:13 user nova-compute[73068]: INFO nova.compute.claims [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Claim successful on node user
Aug 26 12:03:13 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.policy [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39a8587c93764774ac04c74f11ed6498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89262659b6e249969ee0edb7cd482d1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:03:13 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Creating image(s)
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.201s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:03:13 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:03:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.policy [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39a8587c93764774ac04c74f11ed6498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89262659b6e249969ee0edb7cd482d1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk 1073741824" returned: 0 in 0.085s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:03:14 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Creating image(s)
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "/opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.203s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.network.neutron [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Successfully created port: df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Cannot resize image /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Ensure instance console log exists: /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk 1073741824" returned: 0 in 0.072s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Successfully created port: 84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Cannot resize image /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Ensure instance console log exists: /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Successfully updated port: 84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquired lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-5ed168ea-7f64-4335-bb07-ee3e559d5c63 req-7d9a71b3-c2dd-4607-8768-00d4a9527987 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received event network-changed-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-5ed168ea-7f64-4335-bb07-ee3e559d5c63 req-7d9a71b3-c2dd-4607-8768-00d4a9527987 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Refreshing instance network info cache due to event network-changed-84c41e3f-1f99-4539-8c53-cec42ff5a06c. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5ed168ea-7f64-4335-bb07-ee3e559d5c63 req-7d9a71b3-c2dd-4607-8768-00d4a9527987 service nova] Acquiring lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Successfully updated port: df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquired lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:03:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updating instance_info_cache with network_info: [{"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Releasing lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Instance network_info: |[{"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5ed168ea-7f64-4335-bb07-ee3e559d5c63 req-7d9a71b3-c2dd-4607-8768-00d4a9527987 service nova] Acquired lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-5ed168ea-7f64-4335-bb07-ee3e559d5c63 req-7d9a71b3-c2dd-4607-8768-00d4a9527987 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Refreshing network info cache for port 84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Start _get_guest_xml network_info=[{"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-d6e50cea-4a40-4a30-b6a2-7d32fe11788d req-8922b37c-4cb4-41ef-b414-dd8b9b4bbbcd service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-changed-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-d6e50cea-4a40-4a30-b6a2-7d32fe11788d req-8922b37c-4cb4-41ef-b414-dd8b9b4bbbcd service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Refreshing instance network info cache due to event network-changed-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d6e50cea-4a40-4a30-b6a2-7d32fe11788d req-8922b37c-4cb4-41ef-b414-dd8b9b4bbbcd service nova] Acquiring lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:03:16 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:03:16 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1718096530',display_name='tempest-ServerRescueNegativeTestJSON-server-1718096530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1718096530',id=43,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-s770652c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:03:14Z,user_data=None,user_id='39a8587c93764774ac04c74f11ed6498',uuid=6dfa783d-8910-4e63-bbf5-8d803c1b26eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:13:0d,bridge_name='br-int',has_traffic_filtering=True,id=84c41e3f-1f99-4539-8c53-cec42ff5a06c,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c41e3f-1f') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dfa783d-8910-4e63-bbf5-8d803c1b26eb {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:03:16 user nova-compute[73068]:   <uuid>6dfa783d-8910-4e63-bbf5-8d803c1b26eb</uuid>
Aug 26 12:03:16 user nova-compute[73068]:   <name>instance-0000002b</name>
Aug 26 12:03:16 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:03:16 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:03:16 user nova-compute[73068]:   <metadata>
Aug 26 12:03:16 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:03:16 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1718096530</nova:name>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:03:16</nova:creationTime>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:03:16 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:03:16 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:owner>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:user uuid="39a8587c93764774ac04c74f11ed6498">tempest-ServerRescueNegativeTestJSON-982037839-project-member</nova:user>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:project uuid="89262659b6e249969ee0edb7cd482d1f">tempest-ServerRescueNegativeTestJSON-982037839</nova:project>
Aug 26 12:03:16 user nova-compute[73068]:       </nova:owner>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:ports>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:port uuid="84c41e3f-1f99-4539-8c53-cec42ff5a06c">
Aug 26 12:03:16 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 12:03:16 user nova-compute[73068]:         </nova:port>
Aug 26 12:03:16 user nova-compute[73068]:       </nova:ports>
Aug 26 12:03:16 user nova-compute[73068]:     </nova:instance>
Aug 26 12:03:16 user nova-compute[73068]:   </metadata>
Aug 26 12:03:16 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:03:16 user nova-compute[73068]:     <system>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="serial">6dfa783d-8910-4e63-bbf5-8d803c1b26eb</entry>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="uuid">6dfa783d-8910-4e63-bbf5-8d803c1b26eb</entry>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:03:16 user nova-compute[73068]:     </system>
Aug 26 12:03:16 user nova-compute[73068]:   </sysinfo>
Aug 26 12:03:16 user nova-compute[73068]:   <os>
Aug 26 12:03:16 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:03:16 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:03:16 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:03:16 user nova-compute[73068]:   </os>
Aug 26 12:03:16 user nova-compute[73068]:   <features>
Aug 26 12:03:16 user nova-compute[73068]:     <acpi/>
Aug 26 12:03:16 user nova-compute[73068]:     <apic/>
Aug 26 12:03:16 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:03:16 user nova-compute[73068]:   </features>
Aug 26 12:03:16 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:03:16 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:03:16 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:03:16 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:03:16 user nova-compute[73068]:   </clock>
Aug 26 12:03:16 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:03:16 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:03:16 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:03:16 user nova-compute[73068]:   </cpu>
Aug 26 12:03:16 user nova-compute[73068]:   <devices>
Aug 26 12:03:16 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:03:16 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:03:16 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk"/>
Aug 26 12:03:16 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:03:16 user nova-compute[73068]:     </disk>
Aug 26 12:03:16 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:03:16 user nova-compute[73068]:       <mac address="fa:16:3e:d0:13:0d"/>
Aug 26 12:03:16 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:03:16 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:03:16 user nova-compute[73068]:       <target dev="tap84c41e3f-1f"/>
Aug 26 12:03:16 user nova-compute[73068]:     </interface>
Aug 26 12:03:16 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:03:16 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/console.log" append="off"/>
Aug 26 12:03:16 user nova-compute[73068]:     </serial>
Aug 26 12:03:16 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:03:16 user nova-compute[73068]:     <video>
Aug 26 12:03:16 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:03:16 user nova-compute[73068]:     </video>
Aug 26 12:03:16 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:03:16 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:03:16 user nova-compute[73068]:     </rng>
Aug 26 12:03:16 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:03:16 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:03:16 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:03:16 user nova-compute[73068]:     </memballoon>
Aug 26 12:03:16 user nova-compute[73068]:   </devices>
Aug 26 12:03:16 user nova-compute[73068]: </domain>
Aug 26 12:03:16 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1718096530',display_name='tempest-ServerRescueNegativeTestJSON-server-1718096530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1718096530',id=43,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-s770652c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:03:14Z,user_data=None,user_id='39a8587c93764774ac04c74f11ed6498',uuid=6dfa783d-8910-4e63-bbf5-8d803c1b26eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:13:0d,bridge_name='br-int',has_traffic_filtering=True,id=84c41e3f-1f99-4539-8c53-cec42ff5a06c,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c41e3f-1f') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG os_vif [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:13:0d,bridge_name='br-int',has_traffic_filtering=True,id=84c41e3f-1f99-4539-8c53-cec42ff5a06c,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c41e3f-1f') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84c41e3f-1f, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84c41e3f-1f, col_values=(('external_ids', {'iface-id': '84c41e3f-1f99-4539-8c53-cec42ff5a06c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:13:0d', 'vm-uuid': '6dfa783d-8910-4e63-bbf5-8d803c1b26eb'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:16 user nova-compute[73068]: INFO os_vif [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:13:0d,bridge_name='br-int',has_traffic_filtering=True,id=84c41e3f-1f99-4539-8c53-cec42ff5a06c,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c41e3f-1f')
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No VIF found with MAC fa:16:3e:d0:13:0d, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updating instance_info_cache with network_info: [{"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Releasing lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Instance network_info: |[{"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d6e50cea-4a40-4a30-b6a2-7d32fe11788d req-8922b37c-4cb4-41ef-b414-dd8b9b4bbbcd service nova] Acquired lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-d6e50cea-4a40-4a30-b6a2-7d32fe11788d req-8922b37c-4cb4-41ef-b414-dd8b9b4bbbcd service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Refreshing network info cache for port df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Start _get_guest_xml network_info=[{"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:03:16 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:03:16 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-644189681',display_name='tempest-ServerRescueNegativeTestJSON-server-644189681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-644189681',id=42,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-pykyh5j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:03:13Z,user_data=None,user_id='39a8587c93764774ac04c74f11ed6498',uuid=4e21d114-7d6c-4a4a-ab2e-51e7d169fc81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:54:54,bridge_name='br-int',has_traffic_filtering=True,id=df8b5dfa-bb92-47f7-bb60-cb6aee769aa8,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8b5dfa-bb') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.objects.instance [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:03:16 user nova-compute[73068]:   <uuid>4e21d114-7d6c-4a4a-ab2e-51e7d169fc81</uuid>
Aug 26 12:03:16 user nova-compute[73068]:   <name>instance-0000002a</name>
Aug 26 12:03:16 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:03:16 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:03:16 user nova-compute[73068]:   <metadata>
Aug 26 12:03:16 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:03:16 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-644189681</nova:name>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:03:16</nova:creationTime>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:03:16 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:03:16 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:owner>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:user uuid="39a8587c93764774ac04c74f11ed6498">tempest-ServerRescueNegativeTestJSON-982037839-project-member</nova:user>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:project uuid="89262659b6e249969ee0edb7cd482d1f">tempest-ServerRescueNegativeTestJSON-982037839</nova:project>
Aug 26 12:03:16 user nova-compute[73068]:       </nova:owner>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 12:03:16 user nova-compute[73068]:       <nova:ports>
Aug 26 12:03:16 user nova-compute[73068]:         <nova:port uuid="df8b5dfa-bb92-47f7-bb60-cb6aee769aa8">
Aug 26 12:03:16 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 12:03:16 user nova-compute[73068]:         </nova:port>
Aug 26 12:03:16 user nova-compute[73068]:       </nova:ports>
Aug 26 12:03:16 user nova-compute[73068]:     </nova:instance>
Aug 26 12:03:16 user nova-compute[73068]:   </metadata>
Aug 26 12:03:16 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:03:16 user nova-compute[73068]:     <system>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="serial">4e21d114-7d6c-4a4a-ab2e-51e7d169fc81</entry>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="uuid">4e21d114-7d6c-4a4a-ab2e-51e7d169fc81</entry>
Aug 26 12:03:16 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:03:16 user nova-compute[73068]:     </system>
Aug 26 12:03:16 user nova-compute[73068]:   </sysinfo>
Aug 26 12:03:16 user nova-compute[73068]:   <os>
Aug 26 12:03:16 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:03:16 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:03:16 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:03:16 user nova-compute[73068]:   </os>
Aug 26 12:03:16 user nova-compute[73068]:   <features>
Aug 26 12:03:16 user nova-compute[73068]:     <acpi/>
Aug 26 12:03:16 user nova-compute[73068]:     <apic/>
Aug 26 12:03:16 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:03:16 user nova-compute[73068]:   </features>
Aug 26 12:03:16 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:03:16 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:03:16 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:03:16 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:03:16 user nova-compute[73068]:   </clock>
Aug 26 12:03:16 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:03:16 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:03:16 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:03:16 user nova-compute[73068]:   </cpu>
Aug 26 12:03:16 user nova-compute[73068]:   <devices>
Aug 26 12:03:16 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:03:16 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:03:16 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk"/>
Aug 26 12:03:16 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:03:16 user nova-compute[73068]:     </disk>
Aug 26 12:03:16 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:03:16 user nova-compute[73068]:       <mac address="fa:16:3e:55:54:54"/>
Aug 26 12:03:16 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:03:16 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:03:16 user nova-compute[73068]:       <target dev="tapdf8b5dfa-bb"/>
Aug 26 12:03:16 user nova-compute[73068]:     </interface>
Aug 26 12:03:16 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:03:16 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/console.log" append="off"/>
Aug 26 12:03:16 user nova-compute[73068]:     </serial>
Aug 26 12:03:16 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:03:16 user nova-compute[73068]:     <video>
Aug 26 12:03:16 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:03:16 user nova-compute[73068]:     </video>
Aug 26 12:03:16 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:03:16 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:03:16 user nova-compute[73068]:     </rng>
Aug 26 12:03:16 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:03:16 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:03:16 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:03:16 user nova-compute[73068]:     </memballoon>
Aug 26 12:03:16 user nova-compute[73068]:   </devices>
Aug 26 12:03:16 user nova-compute[73068]: </domain>
Aug 26 12:03:16 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-644189681',display_name='tempest-ServerRescueNegativeTestJSON-server-644189681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-644189681',id=42,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-pykyh5j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:03:13Z,user_data=None,user_id='39a8587c93764774ac04c74f11ed6498',uuid=4e21d114-7d6c-4a4a-ab2e-51e7d169fc81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:54:54,bridge_name='br-int',has_traffic_filtering=True,id=df8b5dfa-bb92-47f7-bb60-cb6aee769aa8,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8b5dfa-bb') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG os_vif [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:54:54,bridge_name='br-int',has_traffic_filtering=True,id=df8b5dfa-bb92-47f7-bb60-cb6aee769aa8,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8b5dfa-bb') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf8b5dfa-bb, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf8b5dfa-bb, col_values=(('external_ids', {'iface-id': 'df8b5dfa-bb92-47f7-bb60-cb6aee769aa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:54:54', 'vm-uuid': '4e21d114-7d6c-4a4a-ab2e-51e7d169fc81'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:16 user nova-compute[73068]: INFO os_vif [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:54:54,bridge_name='br-int',has_traffic_filtering=True,id=df8b5dfa-bb92-47f7-bb60-cb6aee769aa8,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8b5dfa-bb')
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No VIF found with MAC fa:16:3e:55:54:54, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-5ed168ea-7f64-4335-bb07-ee3e559d5c63 req-7d9a71b3-c2dd-4607-8768-00d4a9527987 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updated VIF entry in instance network info cache for port 84c41e3f-1f99-4539-8c53-cec42ff5a06c. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG nova.network.neutron [req-5ed168ea-7f64-4335-bb07-ee3e559d5c63 req-7d9a71b3-c2dd-4607-8768-00d4a9527987 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updating instance_info_cache with network_info: [{"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:03:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5ed168ea-7f64-4335-bb07-ee3e559d5c63 req-7d9a71b3-c2dd-4607-8768-00d4a9527987 service nova] Releasing lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:03:17 user nova-compute[73068]: DEBUG nova.network.neutron [req-d6e50cea-4a40-4a30-b6a2-7d32fe11788d req-8922b37c-4cb4-41ef-b414-dd8b9b4bbbcd service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updated VIF entry in instance network info cache for port df8b5dfa-bb92-47f7-bb60-cb6aee769aa8. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:03:17 user nova-compute[73068]: DEBUG nova.network.neutron [req-d6e50cea-4a40-4a30-b6a2-7d32fe11788d req-8922b37c-4cb4-41ef-b414-dd8b9b4bbbcd service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updating instance_info_cache with network_info: [{"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:03:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d6e50cea-4a40-4a30-b6a2-7d32fe11788d req-8922b37c-4cb4-41ef-b414-dd8b9b4bbbcd service nova] Releasing lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:03:17 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "0939f844-e6ee-47fc-a74a-626cb74bf983" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:03:18 user nova-compute[73068]: INFO nova.compute.claims [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Claim successful on node user
Aug 26 12:03:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-0db952f9-729c-4ce2-bea4-8cb7392f38c0 req-9e0cf286-5cc1-45da-9c72-270d6bff53e9 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0db952f9-729c-4ce2-bea4-8cb7392f38c0 req-9e0cf286-5cc1-45da-9c72-270d6bff53e9 service nova] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0db952f9-729c-4ce2-bea4-8cb7392f38c0 req-9e0cf286-5cc1-45da-9c72-270d6bff53e9 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0db952f9-729c-4ce2-bea4-8cb7392f38c0 req-9e0cf286-5cc1-45da-9c72-270d6bff53e9 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-0db952f9-729c-4ce2-bea4-8cb7392f38c0 req-9e0cf286-5cc1-45da-9c72-270d6bff53e9 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] No waiting events found dispatching network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:18 user nova-compute[73068]: WARNING nova.compute.manager [req-0db952f9-729c-4ce2-bea4-8cb7392f38c0 req-9e0cf286-5cc1-45da-9c72-270d6bff53e9 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received unexpected event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c for instance with vm_state building and task_state spawning.
Aug 26 12:03:18 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG nova.network.neutron [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:03:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:03:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:19 user nova-compute[73068]: INFO nova.virt.block_device [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Booting with volume snapshot a28b9b65-0d22-40c2-9237-42e503c25544 at /dev/vda
Aug 26 12:03:19 user nova-compute[73068]: DEBUG nova.policy [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c7914d369aa429394c647f73846fe5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681694efee294a74b277fced3266643d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-295182db-cd27-4307-88b7-970f7f652664 req-0db5f7d0-5c51-442e-930c-b6202a837525 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-295182db-cd27-4307-88b7-970f7f652664 req-0db5f7d0-5c51-442e-930c-b6202a837525 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-295182db-cd27-4307-88b7-970f7f652664 req-0db5f7d0-5c51-442e-930c-b6202a837525 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-295182db-cd27-4307-88b7-970f7f652664 req-0db5f7d0-5c51-442e-930c-b6202a837525 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-295182db-cd27-4307-88b7-970f7f652664 req-0db5f7d0-5c51-442e-930c-b6202a837525 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:19 user nova-compute[73068]: WARNING nova.compute.manager [req-295182db-cd27-4307-88b7-970f7f652664 req-0db5f7d0-5c51-442e-930c-b6202a837525 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state building and task_state spawning.
Aug 26 12:03:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:19 user nova-compute[73068]: DEBUG nova.network.neutron [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Successfully created port: 2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:03:20 user nova-compute[73068]: DEBUG nova.network.neutron [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Successfully updated port: 2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:03:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "refresh_cache-0939f844-e6ee-47fc-a74a-626cb74bf983" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:03:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquired lock "refresh_cache-0939f844-e6ee-47fc-a74a-626cb74bf983" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:03:20 user nova-compute[73068]: DEBUG nova.network.neutron [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:03:20 user nova-compute[73068]: DEBUG nova.network.neutron [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] No waiting events found dispatching network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:21 user nova-compute[73068]: WARNING nova.compute.manager [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received unexpected event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c for instance with vm_state building and task_state spawning.
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Received event network-changed-2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Refreshing instance network info cache due to event network-changed-2003878b-8f30-4c7f-b58d-a967de85098d. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] Acquiring lock "refresh_cache-0939f844-e6ee-47fc-a74a-626cb74bf983" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.network.neutron [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Updating instance_info_cache with network_info: [{"id": "2003878b-8f30-4c7f-b58d-a967de85098d", "address": "fa:16:3e:49:01:ac", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2003878b-8f", "ovs_interfaceid": "2003878b-8f30-4c7f-b58d-a967de85098d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Releasing lock "refresh_cache-0939f844-e6ee-47fc-a74a-626cb74bf983" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Instance network_info: |[{"id": "2003878b-8f30-4c7f-b58d-a967de85098d", "address": "fa:16:3e:49:01:ac", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2003878b-8f", "ovs_interfaceid": "2003878b-8f30-4c7f-b58d-a967de85098d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] Acquired lock "refresh_cache-0939f844-e6ee-47fc-a74a-626cb74bf983" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.network.neutron [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Refreshing network info cache for port 2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051401.2897935, 6dfa783d-8910-4e63-bbf5-8d803c1b26eb => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] VM Resumed (Lifecycle Event)
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Instance spawned successfully.
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-d9da80c6-b8e4-42bd-824e-89bbc0e60a9b req-d2755f7b-7dec-4425-b123-814f82e1d76b service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d9da80c6-b8e4-42bd-824e-89bbc0e60a9b req-d2755f7b-7dec-4425-b123-814f82e1d76b service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d9da80c6-b8e4-42bd-824e-89bbc0e60a9b req-d2755f7b-7dec-4425-b123-814f82e1d76b service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d9da80c6-b8e4-42bd-824e-89bbc0e60a9b req-d2755f7b-7dec-4425-b123-814f82e1d76b service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-d9da80c6-b8e4-42bd-824e-89bbc0e60a9b req-d2755f7b-7dec-4425-b123-814f82e1d76b service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:21 user nova-compute[73068]: WARNING nova.compute.manager [req-d9da80c6-b8e4-42bd-824e-89bbc0e60a9b req-d2755f7b-7dec-4425-b123-814f82e1d76b service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state building and task_state spawning.
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051401.294806, 6dfa783d-8910-4e63-bbf5-8d803c1b26eb => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] VM Started (Lifecycle Event)
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Instance spawned successfully.
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051401.3271513, 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] VM Resumed (Lifecycle Event)
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Took 7.33 seconds to spawn the instance on the hypervisor.
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Took 7.87 seconds to spawn the instance on the hypervisor.
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051401.3302155, 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] VM Started (Lifecycle Event)
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.network.neutron [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Updated VIF entry in instance network info cache for port 2003878b-8f30-4c7f-b58d-a967de85098d. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.network.neutron [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Updating instance_info_cache with network_info: [{"id": "2003878b-8f30-4c7f-b58d-a967de85098d", "address": "fa:16:3e:49:01:ac", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2003878b-8f", "ovs_interfaceid": "2003878b-8f30-4c7f-b58d-a967de85098d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0b4d2d58-cfa8-4b53-a52e-cba1794b6b4c req-19a38cfa-0da0-49c6-914b-299906680ef7 service nova] Releasing lock "refresh_cache-0939f844-e6ee-47fc-a74a-626cb74bf983" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Took 8.23 seconds to build instance.
Aug 26 12:03:21 user nova-compute[73068]: INFO nova.compute.manager [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Took 8.99 seconds to build instance.
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a119eff9-924d-4ca5-aa5e-d0aa48ea5d28 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.335s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-188cb0f7-1ad8-4cfc-b741-4bf26e12dd34 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.162s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:23 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 12:03:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG os_brick.utils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86fb5c0-f8da-4596-9f01-7f6969c836aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cc4101-9fca-4650-bc8b-d7eadb8518e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56d51d8-bd03-4020-b83f-2d0bc76b626e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[de018705-ce41-46f6-a62f-a9cda81a8db7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:03:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:03:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:03:25 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:03:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd34cf57-dad9-44c4-865c-132c55ac8ecc]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:03:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:03:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:03:25 user nova-compute[73068]: DEBUG os_brick.utils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:03:25 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Updating existing volume attachment record: 70352818-b68d-482a-a3d3-b3cbd736981b {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:03:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:03:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:03:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Creating image(s)
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Ensure instance console log exists: /opt/stack/data/nova/instances/0939f844-e6ee-47fc-a74a-626cb74bf983/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Start _get_guest_xml network_info=[{"id": "2003878b-8f30-4c7f-b58d-a967de85098d", "address": "fa:16:3e:49:01:ac", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2003878b-8f", "ovs_interfaceid": "2003878b-8f30-4c7f-b58d-a967de85098d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '70352818-b68d-482a-a3d3-b3cbd736981b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvdKDEeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0939f844-e6ee-47fc-a74a-626cb74bf983', 'attached_at': '', 'detached_at': '', 'volume_id': '97ff85b0-ceea-4cc8-a96b-6a15d4d467ea', 'serial': '97ff85b0-ceea-4cc8-a96b-6a15d4d467ea'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:03:36 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:03:36 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvdKDEeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:03:36 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:03:36 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:03:36 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c74e354-12ac-41da-93fa-c5d0f2b791a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:03:36 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a6181c-d4c6-4b2f-8d5e-54425fbde96c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea] added
Aug 26 12:03:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5980a9-e3d1-41de-85c9-6302fa3bcea8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[732c4132-0dbc-45b3-a83b-41a2d313a16b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvdKDEeC {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tvdKDEeC" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2093c76a-9038-4e8c-8ad7-3e4857ce6b7b]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tvdKDEeC'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa1b691-f774-4a0b-8cc8-d948d4144d9a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f009c2-789c-4d2c-9991-e50264312f9f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:03:36 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:03:36 user nova-compute[73068]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 12:03:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:03:36 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:03:36 user nova-compute[73068]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 12:03:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cf5a9c-7180-4093-baa8-b98f2604f24f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea, portal: 172.16.0.220,3260]
Aug 26 12:03:36 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea, portal: 172.16.0.220,3260] successful.
Aug 26 12:03:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c451d187-c1f0-4c09-b0f3-8de1951188e1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d95f0fd-1762-4c7f-b6d6-ecfd09c5f4f7]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:03:36 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:03:36 user nova-compute[73068]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 12:03:36 user nova-compute[73068]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea (non-flash)
Aug 26 12:03:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:03:36 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:03:36 user nova-compute[73068]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 12:03:36 user nova-compute[73068]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea (non-flash)
Aug 26 12:03:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c77028-544a-49bd-8d92-1906efa98b7b]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvdKDEeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:03:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23935366138393539', 'path': '/dev/sde'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935366138393539', 'path': '/dev/sde'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1820004749',display_name='tempest-TestVolumeBootPattern-server-1820004749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1820004749',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-r1f2zh29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:03:19Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=0939f844-e6ee-47fc-a74a-626cb74bf983,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2003878b-8f30-4c7f-b58d-a967de85098d", "address": "fa:16:3e:49:01:ac", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2003878b-8f", "ovs_interfaceid": "2003878b-8f30-4c7f-b58d-a967de85098d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "2003878b-8f30-4c7f-b58d-a967de85098d", "address": "fa:16:3e:49:01:ac", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2003878b-8f", "ovs_interfaceid": "2003878b-8f30-4c7f-b58d-a967de85098d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:01:ac,bridge_name='br-int',has_traffic_filtering=True,id=2003878b-8f30-4c7f-b58d-a967de85098d,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2003878b-8f') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG nova.objects.instance [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'pci_devices' on Instance uuid 0939f844-e6ee-47fc-a74a-626cb74bf983 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:03:37 user nova-compute[73068]:   <uuid>0939f844-e6ee-47fc-a74a-626cb74bf983</uuid>
Aug 26 12:03:37 user nova-compute[73068]:   <name>instance-0000002c</name>
Aug 26 12:03:37 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:03:37 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:03:37 user nova-compute[73068]:   <metadata>
Aug 26 12:03:37 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:03:37 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:03:37 user nova-compute[73068]:       <nova:name>tempest-TestVolumeBootPattern-server-1820004749</nova:name>
Aug 26 12:03:37 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:03:36</nova:creationTime>
Aug 26 12:03:37 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:03:37 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:03:37 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:03:37 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:03:37 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:03:37 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:03:37 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:03:37 user nova-compute[73068]:       <nova:owner>
Aug 26 12:03:37 user nova-compute[73068]:         <nova:user uuid="1c7914d369aa429394c647f73846fe5a">tempest-TestVolumeBootPattern-731970169-project-member</nova:user>
Aug 26 12:03:37 user nova-compute[73068]:         <nova:project uuid="681694efee294a74b277fced3266643d">tempest-TestVolumeBootPattern-731970169</nova:project>
Aug 26 12:03:37 user nova-compute[73068]:       </nova:owner>
Aug 26 12:03:37 user nova-compute[73068]:       <nova:ports>
Aug 26 12:03:37 user nova-compute[73068]:         <nova:port uuid="2003878b-8f30-4c7f-b58d-a967de85098d">
Aug 26 12:03:37 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 12:03:37 user nova-compute[73068]:         </nova:port>
Aug 26 12:03:37 user nova-compute[73068]:       </nova:ports>
Aug 26 12:03:37 user nova-compute[73068]:     </nova:instance>
Aug 26 12:03:37 user nova-compute[73068]:   </metadata>
Aug 26 12:03:37 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:03:37 user nova-compute[73068]:     <system>
Aug 26 12:03:37 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:03:37 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:03:37 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:03:37 user nova-compute[73068]:       <entry name="serial">0939f844-e6ee-47fc-a74a-626cb74bf983</entry>
Aug 26 12:03:37 user nova-compute[73068]:       <entry name="uuid">0939f844-e6ee-47fc-a74a-626cb74bf983</entry>
Aug 26 12:03:37 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:03:37 user nova-compute[73068]:     </system>
Aug 26 12:03:37 user nova-compute[73068]:   </sysinfo>
Aug 26 12:03:37 user nova-compute[73068]:   <os>
Aug 26 12:03:37 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:03:37 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:03:37 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:03:37 user nova-compute[73068]:   </os>
Aug 26 12:03:37 user nova-compute[73068]:   <features>
Aug 26 12:03:37 user nova-compute[73068]:     <acpi/>
Aug 26 12:03:37 user nova-compute[73068]:     <apic/>
Aug 26 12:03:37 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:03:37 user nova-compute[73068]:   </features>
Aug 26 12:03:37 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:03:37 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:03:37 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:03:37 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:03:37 user nova-compute[73068]:   </clock>
Aug 26 12:03:37 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:03:37 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:03:37 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:03:37 user nova-compute[73068]:   </cpu>
Aug 26 12:03:37 user nova-compute[73068]:   <devices>
Aug 26 12:03:37 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 12:03:37 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:03:37 user nova-compute[73068]:       <source dev="/dev/sde"/>
Aug 26 12:03:37 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:03:37 user nova-compute[73068]:       <serial>97ff85b0-ceea-4cc8-a96b-6a15d4d467ea</serial>
Aug 26 12:03:37 user nova-compute[73068]:     </disk>
Aug 26 12:03:37 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:03:37 user nova-compute[73068]:       <mac address="fa:16:3e:49:01:ac"/>
Aug 26 12:03:37 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:03:37 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:03:37 user nova-compute[73068]:       <target dev="tap2003878b-8f"/>
Aug 26 12:03:37 user nova-compute[73068]:     </interface>
Aug 26 12:03:37 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:03:37 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/0939f844-e6ee-47fc-a74a-626cb74bf983/console.log" append="off"/>
Aug 26 12:03:37 user nova-compute[73068]:     </serial>
Aug 26 12:03:37 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:03:37 user nova-compute[73068]:     <video>
Aug 26 12:03:37 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:03:37 user nova-compute[73068]:     </video>
Aug 26 12:03:37 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:03:37 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:03:37 user nova-compute[73068]:     </rng>
Aug 26 12:03:37 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:03:37 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:03:37 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:03:37 user nova-compute[73068]:     </memballoon>
Aug 26 12:03:37 user nova-compute[73068]:   </devices>
Aug 26 12:03:37 user nova-compute[73068]: </domain>
Aug 26 12:03:37 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1820004749',display_name='tempest-TestVolumeBootPattern-server-1820004749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1820004749',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-r1f2zh29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:03:19Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=0939f844-e6ee-47fc-a74a-626cb74bf983,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2003878b-8f30-4c7f-b58d-a967de85098d", "address": "fa:16:3e:49:01:ac", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2003878b-8f", "ovs_interfaceid": "2003878b-8f30-4c7f-b58d-a967de85098d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "2003878b-8f30-4c7f-b58d-a967de85098d", "address": "fa:16:3e:49:01:ac", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2003878b-8f", "ovs_interfaceid": "2003878b-8f30-4c7f-b58d-a967de85098d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:01:ac,bridge_name='br-int',has_traffic_filtering=True,id=2003878b-8f30-4c7f-b58d-a967de85098d,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2003878b-8f') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG os_vif [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:01:ac,bridge_name='br-int',has_traffic_filtering=True,id=2003878b-8f30-4c7f-b58d-a967de85098d,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2003878b-8f') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2003878b-8f, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2003878b-8f, col_values=(('external_ids', {'iface-id': '2003878b-8f30-4c7f-b58d-a967de85098d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:01:ac', 'vm-uuid': '0939f844-e6ee-47fc-a74a-626cb74bf983'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:37 user nova-compute[73068]: INFO os_vif [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:01:ac,bridge_name='br-int',has_traffic_filtering=True,id=2003878b-8f30-4c7f-b58d-a967de85098d,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2003878b-8f')
Aug 26 12:03:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:03:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No VIF found with MAC fa:16:3e:49:01:ac, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:03:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-242a6ca7-be3c-4803-b815-a2b3e1888029 req-55b90e51-0e06-4c60-a3a4-08c5f7e54d47 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Received event network-vif-plugged-2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-242a6ca7-be3c-4803-b815-a2b3e1888029 req-55b90e51-0e06-4c60-a3a4-08c5f7e54d47 service nova] Acquiring lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-242a6ca7-be3c-4803-b815-a2b3e1888029 req-55b90e51-0e06-4c60-a3a4-08c5f7e54d47 service nova] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-242a6ca7-be3c-4803-b815-a2b3e1888029 req-55b90e51-0e06-4c60-a3a4-08c5f7e54d47 service nova] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-242a6ca7-be3c-4803-b815-a2b3e1888029 req-55b90e51-0e06-4c60-a3a4-08c5f7e54d47 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] No waiting events found dispatching network-vif-plugged-2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:38 user nova-compute[73068]: WARNING nova.compute.manager [req-242a6ca7-be3c-4803-b815-a2b3e1888029 req-55b90e51-0e06-4c60-a3a4-08c5f7e54d47 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Received unexpected event network-vif-plugged-2003878b-8f30-4c7f-b58d-a967de85098d for instance with vm_state building and task_state spawning.
Aug 26 12:03:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051420.8523376, 0939f844-e6ee-47fc-a74a-626cb74bf983 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:03:40 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] VM Resumed (Lifecycle Event)
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:03:40 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Instance spawned successfully.
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:03:40 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051420.8534977, 0939f844-e6ee-47fc-a74a-626cb74bf983 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:03:40 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] VM Started (Lifecycle Event)
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:03:40 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:03:40 user nova-compute[73068]: INFO nova.compute.manager [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 26 12:03:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-593ffbcf-d31f-4a04-b82d-afba4ef8b210 req-68b69817-6fa0-4e39-bc22-67d8843caa16 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Received event network-vif-plugged-2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-593ffbcf-d31f-4a04-b82d-afba4ef8b210 req-68b69817-6fa0-4e39-bc22-67d8843caa16 service nova] Acquiring lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-593ffbcf-d31f-4a04-b82d-afba4ef8b210 req-68b69817-6fa0-4e39-bc22-67d8843caa16 service nova] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-593ffbcf-d31f-4a04-b82d-afba4ef8b210 req-68b69817-6fa0-4e39-bc22-67d8843caa16 service nova] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-593ffbcf-d31f-4a04-b82d-afba4ef8b210 req-68b69817-6fa0-4e39-bc22-67d8843caa16 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] No waiting events found dispatching network-vif-plugged-2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:41 user nova-compute[73068]: WARNING nova.compute.manager [req-593ffbcf-d31f-4a04-b82d-afba4ef8b210 req-68b69817-6fa0-4e39-bc22-67d8843caa16 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Received unexpected event network-vif-plugged-2003878b-8f30-4c7f-b58d-a967de85098d for instance with vm_state building and task_state spawning.
Aug 26 12:03:41 user nova-compute[73068]: INFO nova.compute.manager [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Took 22.58 seconds to build instance.
Aug 26 12:03:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-549b9ddd-0805-469c-bf64-5521acce2b6a tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.681s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-badd5f1b-65f5-46ed-9d32-e957b825b247 req-978e816d-b6ca-4ba7-a564-570ebac8749a service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-changed-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-badd5f1b-65f5-46ed-9d32-e957b825b247 req-978e816d-b6ca-4ba7-a564-570ebac8749a service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Refreshing instance network info cache due to event network-changed-fd463838-cf9f-4607-a540-856cf74753d9. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-badd5f1b-65f5-46ed-9d32-e957b825b247 req-978e816d-b6ca-4ba7-a564-570ebac8749a service nova] Acquiring lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-badd5f1b-65f5-46ed-9d32-e957b825b247 req-978e816d-b6ca-4ba7-a564-570ebac8749a service nova] Acquired lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG nova.network.neutron [req-badd5f1b-65f5-46ed-9d32-e957b825b247 req-978e816d-b6ca-4ba7-a564-570ebac8749a service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Refreshing network info cache for port fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:42 user nova-compute[73068]: INFO nova.compute.manager [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Terminating instance
Aug 26 12:03:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG nova.network.neutron [req-badd5f1b-65f5-46ed-9d32-e957b825b247 req-978e816d-b6ca-4ba7-a564-570ebac8749a service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updated VIF entry in instance network info cache for port fd463838-cf9f-4607-a540-856cf74753d9. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG nova.network.neutron [req-badd5f1b-65f5-46ed-9d32-e957b825b247 req-978e816d-b6ca-4ba7-a564-570ebac8749a service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating instance_info_cache with network_info: [{"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-badd5f1b-65f5-46ed-9d32-e957b825b247 req-978e816d-b6ca-4ba7-a564-570ebac8749a service nova] Releasing lock "refresh_cache-88e1f171-b5e8-4164-a659-69f8fdc653ed" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:42 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Instance destroyed successfully.
Aug 26 12:03:42 user nova-compute[73068]: DEBUG nova.objects.instance [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lazy-loading 'resources' on Instance uuid 88e1f171-b5e8-4164-a659-69f8fdc653ed {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T11:58:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1280182601',display_name='tempest-TestShelveInstance-server-1280182601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1280182601',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGL8Ha7TtzLXzshoSYdSUgbeLXe4Fjn3BpBi7Ymb/G4hsJYJn7NLJ42fo8AhnamN8TZF6r1Zn9z8XzPVcto8SGXZ7Rl9pONBpfaOg3kTKzx2H0ctmX5UTLNwyl9q0NLLQ==',key_name='tempest-TestShelveInstance-2008128873',keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:02:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4d268fa0703413ca9f163a0891bc202',ramdisk_id='',reservation_id='r-80efw2yj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1913379620',owner_user_name='tempest-TestShelveInstance-1913379620-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:02:19Z,user_data=None,user_id='7ee37cf249774afdad5850676ccae88f',uuid=88e1f171-b5e8-4164-a659-69f8fdc653ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converting VIF {"id": "fd463838-cf9f-4607-a540-856cf74753d9", "address": "fa:16:3e:dd:90:d8", "network": {"id": "39dfc761-d794-4994-808a-8e3dc1480f83", "bridge": "br-int", "label": "tempest-TestShelveInstance-1550020938-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4d268fa0703413ca9f163a0891bc202", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd463838-cf", "ovs_interfaceid": "fd463838-cf9f-4607-a540-856cf74753d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG os_vif [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd463838-cf, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:03:42 user nova-compute[73068]: INFO os_vif [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:d8,bridge_name='br-int',has_traffic_filtering=True,id=fd463838-cf9f-4607-a540-856cf74753d9,network=Network(39dfc761-d794-4994-808a-8e3dc1480f83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd463838-cf')
Aug 26 12:03:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Qmktbyxa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:03:42 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:03:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4f7275-91f2-420e-971f-16a6708fc8fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd9be3b-99f2-4201-822e-e8ef37463fe3]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:03:42 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:03:42 user nova-compute[73068]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 12:03:42 user nova-compute[73068]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea (non-flash)
Aug 26 12:03:42 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:03:42 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:03:42 user nova-compute[73068]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 (non-flash)
Aug 26 12:03:42 user nova-compute[73068]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea (non-flash)
Aug 26 12:03:42 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd902d5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[429af17a-8a74-4165-acc5-eb690d197539]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:42 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.048s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb26339-bffa-4a39-9064-60e061384317]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc7f3b3-a5d5-44aa-8a2f-4f6d1dbb58f9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6718ccd-de72-4756-a088-9cdb33cb9fa4]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bd23f08e', '/dev/disk/by-id/scsi-23864393664666162', '/dev/disk/by-id/scsi-1SCST_BIObd23f08e-8d96dfab833063c1') {{(pid=83861) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 12:03:43 user nova-compute[73068]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_bd23f08e
Aug 26 12:03:43 user nova-compute[73068]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23864393664666162
Aug 26 12:03:43 user nova-compute[73068]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIObd23f08e-8d96dfab833063c1
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bfb304-8599-42b3-b7b4-141d3d5b4dc5]: (4, None) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8df100-5e29-4929-a8ab-352686dd5c72]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f22cfe-81ca-443f-b3c5-1457eb75587b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260]
Aug 26 12:03:43 user nova-compute[73068]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3, portal: 172.16.0.220,3260] successful.
Aug 26 12:03:43 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24605550-f83a-422e-98d1-831df5da04a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e86694c-30e5-45a3-af6c-ef3f6427147d]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] <== disconnect_volume: return (368ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:03:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Deleting instance files /opt/stack/data/nova/instances/88e1f171-b5e8-4164-a659-69f8fdc653ed_del
Aug 26 12:03:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Deletion of /opt/stack/data/nova/instances/88e1f171-b5e8-4164-a659-69f8fdc653ed_del complete
Aug 26 12:03:43 user nova-compute[73068]: INFO nova.compute.manager [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:03:43 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Took 0.56 seconds to deallocate network for instance.
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-ce69c411-ad6e-4c3f-b9da-0a2f938dfb0b req-c0e66da9-8acd-4af8-8da1-bb362b823121 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-deleted-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:43 user nova-compute[73068]: INFO nova.compute.manager [req-ce69c411-ad6e-4c3f-b9da-0a2f938dfb0b req-c0e66da9-8acd-4af8-8da1-bb362b823121 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Neutron deleted interface fd463838-cf9f-4607-a540-856cf74753d9; detaching it from the instance and deleting it from the info cache
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.network.neutron [req-ce69c411-ad6e-4c3f-b9da-0a2f938dfb0b req-c0e66da9-8acd-4af8-8da1-bb362b823121 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-ce69c411-ad6e-4c3f-b9da-0a2f938dfb0b req-c0e66da9-8acd-4af8-8da1-bb362b823121 service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Detach interface failed, port_id=fd463838-cf9f-4607-a540-856cf74753d9, reason: Instance 88e1f171-b5e8-4164-a659-69f8fdc653ed could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-unplugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-unplugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-unplugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:43 user nova-compute[73068]: WARNING nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received unexpected event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with vm_state active and task_state deleting.
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:43 user nova-compute[73068]: WARNING nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received unexpected event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with vm_state active and task_state deleting.
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:43 user nova-compute[73068]: WARNING nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received unexpected event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with vm_state active and task_state deleting.
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-unplugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-unplugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-unplugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Acquiring lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:43 user nova-compute[73068]: DEBUG nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] No waiting events found dispatching network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:43 user nova-compute[73068]: WARNING nova.compute.manager [req-d1c3edb8-1d97-4ace-b401-798010802b54 req-01f8ea48-3a95-49ab-af68-0d51adf6d9ce service nova] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Received unexpected event network-vif-plugged-fd463838-cf9f-4607-a540-856cf74753d9 for instance with vm_state active and task_state deleting.
Aug 26 12:03:44 user nova-compute[73068]: INFO nova.compute.manager [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Took 0.88 seconds to detach 1 volumes for instance.
Aug 26 12:03:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Deleting volume: 24605550-f83a-422e-98d1-831df5da04a3 {{(pid=73068) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 12:03:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:45 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:03:45 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:03:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:45 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Deleted allocations for instance 88e1f171-b5e8-4164-a659-69f8fdc653ed
Aug 26 12:03:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7ab4cf06-12b5-4fa3-8a3f-adf6f197ddc3 tempest-TestShelveInstance-1913379620 tempest-TestShelveInstance-1913379620-project-member] Lock "88e1f171-b5e8-4164-a659-69f8fdc653ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.316s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:53 user nova-compute[73068]: INFO nova.compute.manager [None req-0a3c27ac-1f4d-42ba-a1cb-8800029cf00a tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Unrescuing
Aug 26 12:03:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0a3c27ac-1f4d-42ba-a1cb-8800029cf00a tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:03:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0a3c27ac-1f4d-42ba-a1cb-8800029cf00a tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquired lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:03:53 user nova-compute[73068]: DEBUG nova.network.neutron [None req-0a3c27ac-1f4d-42ba-a1cb-8800029cf00a tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:03:54 user nova-compute[73068]: DEBUG nova.network.neutron [None req-0a3c27ac-1f4d-42ba-a1cb-8800029cf00a tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Updating instance_info_cache with network_info: [{"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:03:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0a3c27ac-1f4d-42ba-a1cb-8800029cf00a tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Releasing lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:03:54 user nova-compute[73068]: DEBUG nova.objects.instance [None req-0a3c27ac-1f4d-42ba-a1cb-8800029cf00a tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'flavor' on Instance uuid 8bd308c4-54d4-4883-bf71-9e7c60f79b51 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:03:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-b6b04d92-2499-4d50-a1ae-c6d1fddb0cd8 req-dc0fc729-c51f-4274-998d-93b366754662 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-unplugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b6b04d92-2499-4d50-a1ae-c6d1fddb0cd8 req-dc0fc729-c51f-4274-998d-93b366754662 service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b6b04d92-2499-4d50-a1ae-c6d1fddb0cd8 req-dc0fc729-c51f-4274-998d-93b366754662 service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b6b04d92-2499-4d50-a1ae-c6d1fddb0cd8 req-dc0fc729-c51f-4274-998d-93b366754662 service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-b6b04d92-2499-4d50-a1ae-c6d1fddb0cd8 req-dc0fc729-c51f-4274-998d-93b366754662 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-unplugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:54 user nova-compute[73068]: WARNING nova.compute.manager [req-b6b04d92-2499-4d50-a1ae-c6d1fddb0cd8 req-dc0fc729-c51f-4274-998d-93b366754662 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received unexpected event network-vif-unplugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with vm_state rescued and task_state unrescuing.
Aug 26 12:03:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:55 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Instance destroyed successfully.
Aug 26 12:03:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:56 user nova-compute[73068]: WARNING nova.compute.manager [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received unexpected event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with vm_state rescued and task_state unrescuing.
Aug 26 12:03:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:56 user nova-compute[73068]: WARNING nova.compute.manager [req-374f18d8-6fc9-4bdd-85c6-679b4c8bb16e req-c1e82dc2-e279-4cdf-a6cb-95cceeb267ad service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received unexpected event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with vm_state rescued and task_state unrescuing.
Aug 26 12:03:57 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051422.7971501, 88e1f171-b5e8-4164-a659-69f8fdc653ed => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:03:57 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] VM Stopped (Lifecycle Event)
Aug 26 12:03:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-addd249e-f253-44b6-b3f6-58a91864e331 None None] [instance: 88e1f171-b5e8-4164-a659-69f8fdc653ed] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:03:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for 8bd308c4-54d4-4883-bf71-9e7c60f79b51 due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 12:03:58 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051438.7034638, 8bd308c4-54d4-4883-bf71-9e7c60f79b51 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:03:58 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] VM Resumed (Lifecycle Event)
Aug 26 12:03:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-0a3c27ac-1f4d-42ba-a1cb-8800029cf00a tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:03:58 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 12:03:58 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051438.7058976, 8bd308c4-54d4-4883-bf71-9e7c60f79b51 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:03:58 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] VM Started (Lifecycle Event)
Aug 26 12:03:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:03:58 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:03:58 user nova-compute[73068]: DEBUG nova.compute.manager [req-5196ff49-eca1-4231-836d-1cb9999dbc07 req-293a9c9c-e948-45b5-a4fa-439be677502e service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:03:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5196ff49-eca1-4231-836d-1cb9999dbc07 req-293a9c9c-e948-45b5-a4fa-439be677502e service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:03:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5196ff49-eca1-4231-836d-1cb9999dbc07 req-293a9c9c-e948-45b5-a4fa-439be677502e service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:03:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5196ff49-eca1-4231-836d-1cb9999dbc07 req-293a9c9c-e948-45b5-a4fa-439be677502e service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:03:58 user nova-compute[73068]: DEBUG nova.compute.manager [req-5196ff49-eca1-4231-836d-1cb9999dbc07 req-293a9c9c-e948-45b5-a4fa-439be677502e service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:03:58 user nova-compute[73068]: WARNING nova.compute.manager [req-5196ff49-eca1-4231-836d-1cb9999dbc07 req-293a9c9c-e948-45b5-a4fa-439be677502e service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received unexpected event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with vm_state active and task_state None.
Aug 26 12:04:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:07 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:04:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:04:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:04:08 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:04:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:04:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:04:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:04:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:04:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:04:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:04:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-b148f5b5-ada4-49a6-9e9c-cd04283223ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:04:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-b148f5b5-ada4-49a6-9e9c-cd04283223ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:04:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:04:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Updating instance_info_cache with network_info: [{"id": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "address": "fa:16:3e:1e:1c:e6", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6af2c1-22", "ovs_interfaceid": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-b148f5b5-ada4-49a6-9e9c-cd04283223ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:04:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:04:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:04:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:04:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:04:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:04:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:04:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:04:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:04:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:04:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=7881MB free_disk=25.008304595947266GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance b148f5b5-ada4-49a6-9e9c-cd04283223ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8bd308c4-54d4-4883-bf71-9e7c60f79b51 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 0939f844-e6ee-47fc-a74a-626cb74bf983 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:04:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:04:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:04:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:04:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:04:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:04:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:04:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:04:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:04:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:04:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:04:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:04:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:05:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:05:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:05:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:05:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:05:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:03 user nova-compute[73068]: INFO nova.compute.manager [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Rescuing
Aug 26 12:05:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:05:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquired lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:05:03 user nova-compute[73068]: DEBUG nova.network.neutron [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:05:03 user nova-compute[73068]: DEBUG nova.network.neutron [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updating instance_info_cache with network_info: [{"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:05:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Releasing lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG nova.compute.manager [req-a2cbd25b-a8ba-4df9-a587-297816f108ee req-4ffea726-d2fd-4752-ab28-a21fa8d5eb8e service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received event network-vif-unplugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a2cbd25b-a8ba-4df9-a587-297816f108ee req-4ffea726-d2fd-4752-ab28-a21fa8d5eb8e service nova] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a2cbd25b-a8ba-4df9-a587-297816f108ee req-4ffea726-d2fd-4752-ab28-a21fa8d5eb8e service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a2cbd25b-a8ba-4df9-a587-297816f108ee req-4ffea726-d2fd-4752-ab28-a21fa8d5eb8e service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG nova.compute.manager [req-a2cbd25b-a8ba-4df9-a587-297816f108ee req-4ffea726-d2fd-4752-ab28-a21fa8d5eb8e service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] No waiting events found dispatching network-vif-unplugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:05:04 user nova-compute[73068]: WARNING nova.compute.manager [req-a2cbd25b-a8ba-4df9-a587-297816f108ee req-4ffea726-d2fd-4752-ab28-a21fa8d5eb8e service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received unexpected event network-vif-unplugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c for instance with vm_state active and task_state rescuing.
Aug 26 12:05:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:04 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Instance destroyed successfully.
Aug 26 12:05:04 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Attempting rescue
Aug 26 12:05:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73068) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Instance directory exists: not creating {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 12:05:04 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Creating image(s)
Aug 26 12:05:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "/opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG nova.objects.instance [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6dfa783d-8910-4e63-bbf5-8d803c1b26eb {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.217s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue" returned: 0 in 0.054s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.objects.instance [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'migration_context' on Instance uuid 6dfa783d-8910-4e63-bbf5-8d803c1b26eb {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.objects.base [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<6dfa783d-8910-4e63-bbf5-8d803c1b26eb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Start _get_guest_xml network_info=[{"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "vif_mac": "fa:16:3e:d0:13:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.objects.instance [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'resources' on Instance uuid 6dfa783d-8910-4e63-bbf5-8d803c1b26eb {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.objects.base [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<6dfa783d-8910-4e63-bbf5-8d803c1b26eb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.objects.instance [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'numa_topology' on Instance uuid 6dfa783d-8910-4e63-bbf5-8d803c1b26eb {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.objects.base [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<6dfa783d-8910-4e63-bbf5-8d803c1b26eb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:05:05 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:05:05 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.objects.instance [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6dfa783d-8910-4e63-bbf5-8d803c1b26eb {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.objects.base [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<6dfa783d-8910-4e63-bbf5-8d803c1b26eb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1718096530',display_name='tempest-ServerRescueNegativeTestJSON-server-1718096530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1718096530',id=43,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-s770652c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:03:22Z,user_data=None,user_id='39a8587c93764774ac04c74f11ed6498',uuid=6dfa783d-8910-4e63-bbf5-8d803c1b26eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "vif_mac": "fa:16:3e:d0:13:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "vif_mac": "fa:16:3e:d0:13:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:13:0d,bridge_name='br-int',has_traffic_filtering=True,id=84c41e3f-1f99-4539-8c53-cec42ff5a06c,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c41e3f-1f') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.objects.instance [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dfa783d-8910-4e63-bbf5-8d803c1b26eb {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.objects.base [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<6dfa783d-8910-4e63-bbf5-8d803c1b26eb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:05:05 user nova-compute[73068]:   <uuid>6dfa783d-8910-4e63-bbf5-8d803c1b26eb</uuid>
Aug 26 12:05:05 user nova-compute[73068]:   <name>instance-0000002b</name>
Aug 26 12:05:05 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:05:05 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:05:05 user nova-compute[73068]:   <metadata>
Aug 26 12:05:05 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:05:05 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:05:05 user nova-compute[73068]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1718096530</nova:name>
Aug 26 12:05:05 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:05:05</nova:creationTime>
Aug 26 12:05:05 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:05:05 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:05:05 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:05:05 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:05:05 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:05:05 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:05:05 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:05:05 user nova-compute[73068]:       <nova:owner>
Aug 26 12:05:05 user nova-compute[73068]:         <nova:user uuid="39a8587c93764774ac04c74f11ed6498">tempest-ServerRescueNegativeTestJSON-982037839-project-member</nova:user>
Aug 26 12:05:05 user nova-compute[73068]:         <nova:project uuid="89262659b6e249969ee0edb7cd482d1f">tempest-ServerRescueNegativeTestJSON-982037839</nova:project>
Aug 26 12:05:05 user nova-compute[73068]:       </nova:owner>
Aug 26 12:05:05 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 12:05:05 user nova-compute[73068]:       <nova:ports>
Aug 26 12:05:05 user nova-compute[73068]:         <nova:port uuid="84c41e3f-1f99-4539-8c53-cec42ff5a06c">
Aug 26 12:05:05 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 12:05:05 user nova-compute[73068]:         </nova:port>
Aug 26 12:05:05 user nova-compute[73068]:       </nova:ports>
Aug 26 12:05:05 user nova-compute[73068]:     </nova:instance>
Aug 26 12:05:05 user nova-compute[73068]:   </metadata>
Aug 26 12:05:05 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:05:05 user nova-compute[73068]:     <system>
Aug 26 12:05:05 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:05:05 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:05:05 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:05:05 user nova-compute[73068]:       <entry name="serial">6dfa783d-8910-4e63-bbf5-8d803c1b26eb</entry>
Aug 26 12:05:05 user nova-compute[73068]:       <entry name="uuid">6dfa783d-8910-4e63-bbf5-8d803c1b26eb</entry>
Aug 26 12:05:05 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:05:05 user nova-compute[73068]:     </system>
Aug 26 12:05:05 user nova-compute[73068]:   </sysinfo>
Aug 26 12:05:05 user nova-compute[73068]:   <os>
Aug 26 12:05:05 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:05:05 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:05:05 user nova-compute[73068]:   </os>
Aug 26 12:05:05 user nova-compute[73068]:   <features>
Aug 26 12:05:05 user nova-compute[73068]:     <acpi/>
Aug 26 12:05:05 user nova-compute[73068]:     <apic/>
Aug 26 12:05:05 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:05:05 user nova-compute[73068]:   </features>
Aug 26 12:05:05 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:05:05 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:05:05 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:05:05 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:05:05 user nova-compute[73068]:   </clock>
Aug 26 12:05:05 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:05:05 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:05:05 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:05:05 user nova-compute[73068]:   </cpu>
Aug 26 12:05:05 user nova-compute[73068]:   <devices>
Aug 26 12:05:05 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:05:05 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:05:05 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue"/>
Aug 26 12:05:05 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:05:05 user nova-compute[73068]:     </disk>
Aug 26 12:05:05 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:05:05 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:05:05 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk"/>
Aug 26 12:05:05 user nova-compute[73068]:       <target dev="vdb" bus="virtio"/>
Aug 26 12:05:05 user nova-compute[73068]:     </disk>
Aug 26 12:05:05 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:05:05 user nova-compute[73068]:       <mac address="fa:16:3e:d0:13:0d"/>
Aug 26 12:05:05 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:05:05 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:05:05 user nova-compute[73068]:       <target dev="tap84c41e3f-1f"/>
Aug 26 12:05:05 user nova-compute[73068]:     </interface>
Aug 26 12:05:05 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:05:05 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/console.log" append="off"/>
Aug 26 12:05:05 user nova-compute[73068]:     </serial>
Aug 26 12:05:05 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:05:05 user nova-compute[73068]:     <video>
Aug 26 12:05:05 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:05:05 user nova-compute[73068]:     </video>
Aug 26 12:05:05 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:05:05 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:05:05 user nova-compute[73068]:     </rng>
Aug 26 12:05:05 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:05:05 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:05:05 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:05:05 user nova-compute[73068]:     </memballoon>
Aug 26 12:05:05 user nova-compute[73068]:   </devices>
Aug 26 12:05:05 user nova-compute[73068]: </domain>
Aug 26 12:05:05 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:05:05 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Instance destroyed successfully.
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:05:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No VIF found with MAC fa:16:3e:d0:13:0d, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:05:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-f7bef296-809c-4c29-b250-8d0bb7d05afe req-ce9392a3-6a21-42eb-aad6-07b3b36c8e82 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:05:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f7bef296-809c-4c29-b250-8d0bb7d05afe req-ce9392a3-6a21-42eb-aad6-07b3b36c8e82 service nova] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f7bef296-809c-4c29-b250-8d0bb7d05afe req-ce9392a3-6a21-42eb-aad6-07b3b36c8e82 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f7bef296-809c-4c29-b250-8d0bb7d05afe req-ce9392a3-6a21-42eb-aad6-07b3b36c8e82 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-f7bef296-809c-4c29-b250-8d0bb7d05afe req-ce9392a3-6a21-42eb-aad6-07b3b36c8e82 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] No waiting events found dispatching network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:05:06 user nova-compute[73068]: WARNING nova.compute.manager [req-f7bef296-809c-4c29-b250-8d0bb7d05afe req-ce9392a3-6a21-42eb-aad6-07b3b36c8e82 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received unexpected event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c for instance with vm_state active and task_state rescuing.
Aug 26 12:05:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] No waiting events found dispatching network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:05:08 user nova-compute[73068]: WARNING nova.compute.manager [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received unexpected event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c for instance with vm_state active and task_state rescuing.
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] No waiting events found dispatching network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:05:08 user nova-compute[73068]: WARNING nova.compute.manager [req-00d92d54-7dea-428c-ba08-a7adc389c384 req-51a8191f-e4ea-4f24-8ecd-921717e62679 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received unexpected event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c for instance with vm_state active and task_state rescuing.
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for 6dfa783d-8910-4e63-bbf5-8d803c1b26eb due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051508.7068043, 6dfa783d-8910-4e63-bbf5-8d803c1b26eb => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:05:08 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] VM Resumed (Lifecycle Event)
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-0c8a7edc-3ec1-4c93-8e14-40845a745676 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:05:08 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051508.7083502, 6dfa783d-8910-4e63-bbf5-8d803c1b26eb => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:05:08 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] VM Started (Lifecycle Event)
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:05:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "0939f844-e6ee-47fc-a74a-626cb74bf983" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:09 user nova-compute[73068]: INFO nova.compute.manager [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Terminating instance
Aug 26 12:05:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Instance destroyed successfully.
Aug 26 12:05:09 user nova-compute[73068]: DEBUG nova.objects.instance [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'resources' on Instance uuid 0939f844-e6ee-47fc-a74a-626cb74bf983 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1820004749',display_name='tempest-TestVolumeBootPattern-server-1820004749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1820004749',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-r1f2zh29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:03:41Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=0939f844-e6ee-47fc-a74a-626cb74bf983,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2003878b-8f30-4c7f-b58d-a967de85098d", "address": "fa:16:3e:49:01:ac", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2003878b-8f", "ovs_interfaceid": "2003878b-8f30-4c7f-b58d-a967de85098d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "2003878b-8f30-4c7f-b58d-a967de85098d", "address": "fa:16:3e:49:01:ac", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2003878b-8f", "ovs_interfaceid": "2003878b-8f30-4c7f-b58d-a967de85098d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:01:ac,bridge_name='br-int',has_traffic_filtering=True,id=2003878b-8f30-4c7f-b58d-a967de85098d,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2003878b-8f') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:05:09 user nova-compute[73068]: DEBUG os_vif [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:01:ac,bridge_name='br-int',has_traffic_filtering=True,id=2003878b-8f30-4c7f-b58d-a967de85098d,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2003878b-8f') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2003878b-8f, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:05:10 user nova-compute[73068]: INFO os_vif [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:01:ac,bridge_name='br-int',has_traffic_filtering=True,id=2003878b-8f30-4c7f-b58d-a967de85098d,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2003878b-8f')
Aug 26 12:05:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tvdKDEeC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:05:10 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9d5ad-ae7a-4a7a-8897-3932beb08a8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f612d37-3900-4bc0-a2c7-2d2f2b5343ac]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:05:10 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:05:10 user nova-compute[73068]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea (non-flash)
Aug 26 12:05:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:05:10 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:05:10 user nova-compute[73068]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea (non-flash)
Aug 26 12:05:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd907cfe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea'): ({'sde'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Removing single pathed devices sde {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fb7321-0cbe-4955-8c1f-68073040666b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5d9449-ac9e-4136-b708-c485f9ebfe50]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flushing IO for device /dev/sde {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc1301b-22c9-48f2-a2f4-d39b53210dcd]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[75357cb6-f1ac-4adf-9dee-858c8fd32f14]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] SCSI volumes sde have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_92321a72', '/dev/disk/by-id/scsi-23935366138393539', '/dev/disk/by-id/scsi-1SCST_BIO92321a72-956a8959cf18e7a1') {{(pid=83861) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e809e65-ed40-4924-a72e-a5bf3ca6cbed]: (4, None) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28d43f1-0432-4c9b-ac91-c75d52a7911e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0c50b8-160d-4a36-8414-86f29c58870d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea, portal: 172.16.0.220,3260]
Aug 26 12:05:10 user nova-compute[73068]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea, portal: 172.16.0.220,3260] successful.
Aug 26 12:05:10 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97ff85b0-ceea-4cc8-a96b-6a15d4d467ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[722eaa22-ff48-40d0-9ca8-86e57f839b01]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== disconnect_volume: return (305ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:05:10 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Deleting instance files /opt/stack/data/nova/instances/0939f844-e6ee-47fc-a74a-626cb74bf983_del
Aug 26 12:05:10 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Deletion of /opt/stack/data/nova/instances/0939f844-e6ee-47fc-a74a-626cb74bf983_del complete
Aug 26 12:05:10 user nova-compute[73068]: INFO nova.compute.manager [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Received event network-vif-unplugged-2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] Acquiring lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] No waiting events found dispatching network-vif-unplugged-2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Received event network-vif-unplugged-2003878b-8f30-4c7f-b58d-a967de85098d for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Received event network-vif-plugged-2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] Acquiring lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] No waiting events found dispatching network-vif-plugged-2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:05:10 user nova-compute[73068]: WARNING nova.compute.manager [req-42a73b19-09e8-4128-ac3c-5224718ec434 req-b404909f-65ca-4ade-88cb-8153ea22223d service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Received unexpected event network-vif-plugged-2003878b-8f30-4c7f-b58d-a967de85098d for instance with vm_state active and task_state deleting.
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:05:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:05:10 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Took 0.51 seconds to deallocate network for instance.
Aug 26 12:05:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:11 user nova-compute[73068]: INFO nova.compute.manager [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Took 0.85 seconds to detach 1 volumes for instance.
Aug 26 12:05:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Deleting volume: 97ff85b0-ceea-4cc8-a96b-6a15d4d467ea {{(pid=73068) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:12 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Deleted allocations for instance 0939f844-e6ee-47fc-a74a-626cb74bf983
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-53261cff-ff4a-4125-8512-0a51ee9f8795 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "0939f844-e6ee-47fc-a74a-626cb74bf983" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.164s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-e1b22d4a-0f61-45ac-84d7-4ba59c0c6414 req-71f8ece2-3420-4781-a37e-c0c311e6bd26 service nova] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Received event network-vif-deleted-2003878b-8f30-4c7f-b58d-a967de85098d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:05:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8328MB free_disk=25.006214141845703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance b148f5b5-ada4-49a6-9e9c-cd04283223ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 8bd308c4-54d4-4883-bf71-9e7c60f79b51 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:05:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:05:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:05:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:05:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:05:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:05:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Updating instance_info_cache with network_info: [{"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:05:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-8bd308c4-54d4-4883-bf71-9e7c60f79b51" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:05:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:05:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:05:24 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051509.9733372, 0939f844-e6ee-47fc-a74a-626cb74bf983 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:05:24 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] VM Stopped (Lifecycle Event)
Aug 26 12:05:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b7375a31-1249-48fd-b50c-6f4c2d25c596 None None] [instance: 0939f844-e6ee-47fc-a74a-626cb74bf983] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:05:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:05:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:05:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:05:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:05:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:31 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:05:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:45 user nova-compute[73068]: INFO nova.compute.manager [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Terminating instance
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-cc6bc614-a189-428a-948e-1f53fcde7656 req-36a5aed3-f120-4f5f-9b5c-feaff9154729 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-unplugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cc6bc614-a189-428a-948e-1f53fcde7656 req-36a5aed3-f120-4f5f-9b5c-feaff9154729 service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cc6bc614-a189-428a-948e-1f53fcde7656 req-36a5aed3-f120-4f5f-9b5c-feaff9154729 service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cc6bc614-a189-428a-948e-1f53fcde7656 req-36a5aed3-f120-4f5f-9b5c-feaff9154729 service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-cc6bc614-a189-428a-948e-1f53fcde7656 req-36a5aed3-f120-4f5f-9b5c-feaff9154729 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-unplugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.compute.manager [req-cc6bc614-a189-428a-948e-1f53fcde7656 req-36a5aed3-f120-4f5f-9b5c-feaff9154729 service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-unplugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:45 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Instance destroyed successfully.
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.objects.instance [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'resources' on Instance uuid 8bd308c4-54d4-4883-bf71-9e7c60f79b51 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:00:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-153523745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-153523745',id=41,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:02:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-wu1tx9q6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:03:59Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=8bd308c4-54d4-4883-bf71-9e7c60f79b51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "address": "fa:16:3e:3e:68:20", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd87c374-80", "ovs_interfaceid": "cd87c374-80d6-476b-99c0-0f1e9e1f960f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:68:20,bridge_name='br-int',has_traffic_filtering=True,id=cd87c374-80d6-476b-99c0-0f1e9e1f960f,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd87c374-80') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_vif [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:68:20,bridge_name='br-int',has_traffic_filtering=True,id=cd87c374-80d6-476b-99c0-0f1e9e1f960f,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd87c374-80') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd87c374-80, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:45 user nova-compute[73068]: INFO os_vif [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:68:20,bridge_name='br-int',has_traffic_filtering=True,id=cd87c374-80d6-476b-99c0-0f1e9e1f960f,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd87c374-80')
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aOumRbPH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:05:45 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed668b8c-1a06-4d6e-9413-6d5f24edc303]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10acb0d-5ea5-47cd-b910-cedbc4239a14]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:05:45 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:05:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:05:45 user nova-compute[73068]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc (non-flash)
Aug 26 12:05:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd902d60e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc'): ({'sdd'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Removing single pathed devices sdd {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b153ca-871a-4cc5-b0ec-38767461f901]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c9b00d-1090-4492-973d-45d44ee1c60c]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flushing IO for device /dev/sdd {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe81a50-993b-4890-b63f-af8a93ca2145]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d49693f-92ba-4884-991b-43c0ba59df72]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23433643830326364', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_306bda16', '/dev/disk/by-id/scsi-1SCST_BIO306bda16-43d802cd698466b1') {{(pid=83861) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cfdadb-6bb5-4c1d-9239-1c448ae64abe]: (4, None) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[651d50e8-3f26-41bd-be7a-c73d8b03adc8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2193219d-022b-4254-8af3-a36aa2f50a3f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc, portal: 172.16.0.220,3260]
Aug 26 12:05:45 user nova-compute[73068]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc, portal: 172.16.0.220,3260] successful.
Aug 26 12:05:45 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25b88969-11a4-4f67-a156-d59abc039ddc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c99a93f-e72d-4fa9-b5da-702091a3f7b6]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] <== disconnect_volume: return (264ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:05:45 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Deleting instance files /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51_del
Aug 26 12:05:45 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Deletion of /opt/stack/data/nova/instances/8bd308c4-54d4-4883-bf71-9e7c60f79b51_del complete
Aug 26 12:05:45 user nova-compute[73068]: INFO nova.compute.manager [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 12:05:45 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:05:45 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:05:46 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:05:46 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Took 0.55 seconds to deallocate network for instance.
Aug 26 12:05:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-297a44cc-b65b-4173-867c-057a7c2d9748 req-755252e3-4117-4c56-9f1a-2665ca8a5dcc service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-deleted-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:05:47 user nova-compute[73068]: INFO nova.compute.manager [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Took 0.80 seconds to detach 1 volumes for instance.
Aug 26 12:05:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:47 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:05:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-344b3fac-c33f-4b99-820e-02eb3e74b245 req-c6486fef-43ef-4ef8-9133-16f47e71133e service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:05:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-344b3fac-c33f-4b99-820e-02eb3e74b245 req-c6486fef-43ef-4ef8-9133-16f47e71133e service nova] Acquiring lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:05:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-344b3fac-c33f-4b99-820e-02eb3e74b245 req-c6486fef-43ef-4ef8-9133-16f47e71133e service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:05:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-344b3fac-c33f-4b99-820e-02eb3e74b245 req-c6486fef-43ef-4ef8-9133-16f47e71133e service nova] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:47 user nova-compute[73068]: DEBUG nova.compute.manager [req-344b3fac-c33f-4b99-820e-02eb3e74b245 req-c6486fef-43ef-4ef8-9133-16f47e71133e service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] No waiting events found dispatching network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:05:47 user nova-compute[73068]: WARNING nova.compute.manager [req-344b3fac-c33f-4b99-820e-02eb3e74b245 req-c6486fef-43ef-4ef8-9133-16f47e71133e service nova] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Received unexpected event network-vif-plugged-cd87c374-80d6-476b-99c0-0f1e9e1f960f for instance with vm_state deleted and task_state None.
Aug 26 12:05:47 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:05:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:47 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Deleted allocations for instance 8bd308c4-54d4-4883-bf71-9e7c60f79b51
Aug 26 12:05:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-1337aeda-5f9f-41e8-a1c5-ceeeebf4e1b3 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "8bd308c4-54d4-4883-bf71-9e7c60f79b51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.646s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:05:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:05:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:00 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051545.5760183, 8bd308c4-54d4-4883-bf71-9e7c60f79b51 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:06:00 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] VM Stopped (Lifecycle Event)
Aug 26 12:06:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-387ec80e-f4c5-45a0-840e-41603321b264 None None] [instance: 8bd308c4-54d4-4883-bf71-9e7c60f79b51] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:06:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:06:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:06:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:06:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:06:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:06:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:06:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:06:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:06:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:06:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:06:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:06:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8398MB free_disk=25.00491714477539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:06:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:06:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:06:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance b148f5b5-ada4-49a6-9e9c-cd04283223ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:06:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:06:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:06:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:06:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:06:14 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:06:14 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:06:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:06:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:06:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:06:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 12:06:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:06:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:06:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:06:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:06:26 user nova-compute[73068]: INFO nova.compute.claims [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Claim successful on node user
Aug 26 12:06:26 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:06:26 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:06:26 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:06:26 user nova-compute[73068]: INFO nova.virt.block_device [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Booting with volume f2830e16-7de3-4f65-b6df-95a825b95c69 at /dev/vda
Aug 26 12:06:26 user nova-compute[73068]: DEBUG nova.policy [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c7914d369aa429394c647f73846fe5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681694efee294a74b277fced3266643d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG os_brick.utils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9f730-97f1-4d9e-a1cf-62428dd31baa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[491930a3-fd65-47dd-8e99-d9ba3db3dc95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6129bd4-e0d2-4370-93de-78682b7e7333]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e5fef2-5c45-4a3a-9edf-07ce87cb0287]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:06:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:06:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:06:27 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:06:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6babfd1c-1fd1-4a3c-ac03-187d9b034c99]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:06:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:06:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:06:27 user nova-compute[73068]: DEBUG os_brick.utils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:06:27 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Updating existing volume attachment record: 25c0b981-803d-4b00-99b8-15dc361dad4d {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:06:27 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Successfully created port: d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Successfully updated port: d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquired lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-69e79cc7-7ea0-4670-9654-bcf3eeb48ff2 req-057ef149-8247-4c03-ad68-915f35f1a2f1 service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Received event network-changed-d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-69e79cc7-7ea0-4670-9654-bcf3eeb48ff2 req-057ef149-8247-4c03-ad68-915f35f1a2f1 service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Refreshing instance network info cache due to event network-changed-d4f80623-0b79-4f2a-9ae1-577141459f97. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-69e79cc7-7ea0-4670-9654-bcf3eeb48ff2 req-057ef149-8247-4c03-ad68-915f35f1a2f1 service nova] Acquiring lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Updating instance_info_cache with network_info: [{"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Releasing lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Instance network_info: |[{"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-69e79cc7-7ea0-4670-9654-bcf3eeb48ff2 req-057ef149-8247-4c03-ad68-915f35f1a2f1 service nova] Acquired lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-69e79cc7-7ea0-4670-9654-bcf3eeb48ff2 req-057ef149-8247-4c03-ad68-915f35f1a2f1 service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Refreshing network info cache for port d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-69e79cc7-7ea0-4670-9654-bcf3eeb48ff2 req-057ef149-8247-4c03-ad68-915f35f1a2f1 service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Updated VIF entry in instance network info cache for port d4f80623-0b79-4f2a-9ae1-577141459f97. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-69e79cc7-7ea0-4670-9654-bcf3eeb48ff2 req-057ef149-8247-4c03-ad68-915f35f1a2f1 service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Updating instance_info_cache with network_info: [{"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:06:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-69e79cc7-7ea0-4670-9654-bcf3eeb48ff2 req-057ef149-8247-4c03-ad68-915f35f1a2f1 service nova] Releasing lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:06:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:06:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:35 user nova-compute[73068]: INFO nova.compute.manager [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Terminating instance
Aug 26 12:06:35 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:06:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-fc7ef1b2-eb24-49e8-8eaa-138ef6032ce1 req-f53f294c-1bec-48cb-b333-1de7f99dab9f service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Received event network-vif-unplugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fc7ef1b2-eb24-49e8-8eaa-138ef6032ce1 req-f53f294c-1bec-48cb-b333-1de7f99dab9f service nova] Acquiring lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fc7ef1b2-eb24-49e8-8eaa-138ef6032ce1 req-f53f294c-1bec-48cb-b333-1de7f99dab9f service nova] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fc7ef1b2-eb24-49e8-8eaa-138ef6032ce1 req-f53f294c-1bec-48cb-b333-1de7f99dab9f service nova] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-fc7ef1b2-eb24-49e8-8eaa-138ef6032ce1 req-f53f294c-1bec-48cb-b333-1de7f99dab9f service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] No waiting events found dispatching network-vif-unplugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG nova.compute.manager [req-fc7ef1b2-eb24-49e8-8eaa-138ef6032ce1 req-f53f294c-1bec-48cb-b333-1de7f99dab9f service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Received event network-vif-unplugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:06:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Instance destroyed successfully.
Aug 26 12:06:36 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'resources' on Instance uuid b148f5b5-ada4-49a6-9e9c-cd04283223ee {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-321180029',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-321180029',id=39,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:57:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-7if205kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:59:09Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=b148f5b5-ada4-49a6-9e9c-cd04283223ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "address": "fa:16:3e:1e:1c:e6", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6af2c1-22", "ovs_interfaceid": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "address": "fa:16:3e:1e:1c:e6", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6af2c1-22", "ovs_interfaceid": "9a6af2c1-2262-4553-bd47-ac5f57131fdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:1c:e6,bridge_name='br-int',has_traffic_filtering=True,id=9a6af2c1-2262-4553-bd47-ac5f57131fdc,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6af2c1-22') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG os_vif [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:1c:e6,bridge_name='br-int',has_traffic_filtering=True,id=9a6af2c1-2262-4553-bd47-ac5f57131fdc,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6af2c1-22') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a6af2c1-22, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:06:36 user nova-compute[73068]: INFO os_vif [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:1c:e6,bridge_name='br-int',has_traffic_filtering=True,id=9a6af2c1-2262-4553-bd47-ac5f57131fdc,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6af2c1-22')
Aug 26 12:06:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Deleting instance files /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee_del
Aug 26 12:06:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Deletion of /opt/stack/data/nova/instances/b148f5b5-ada4-49a6-9e9c-cd04283223ee_del complete
Aug 26 12:06:36 user nova-compute[73068]: INFO nova.compute.manager [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 26 12:06:36 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:06:36 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:06:37 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Took 0.44 seconds to deallocate network for instance.
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:37 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Deleted allocations for instance b148f5b5-ada4-49a6-9e9c-cd04283223ee
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a959e94d-66c4-436f-a2b8-de751400adef tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.709s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:06:37 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Creating image(s)
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Ensure instance console log exists: /opt/stack/data/nova/instances/3d1a9d9e-10d7-495d-8cdf-d2470ca185ee/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Start _get_guest_xml network_info=[{"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '25c0b981-803d-4b00-99b8-15dc361dad4d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npKiyNow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d1a9d9e-10d7-495d-8cdf-d2470ca185ee', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2830e16-7de3-4f65-b6df-95a825b95c69', 'serial': 'f2830e16-7de3-4f65-b6df-95a825b95c69'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:06:37 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:06:37 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npKiyNow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:06:37 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:06:37 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:06:37 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a7a2c4-2550-4bd6-844f-697520ec4db5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:06:37 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d563d5-3aa3-47eb-abe6-87d1a587a223]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69] added
Aug 26 12:06:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[14329310-be24-42c0-b6f2-113c5913144a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8778c51a-d653-4f1d-96a7-618a804f27aa]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npKiyNow {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npKiyNow" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[434700cd-6cfe-47dc-b77d-33b601a538ee]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npKiyNow'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[453e7824-8bee-4f45-a850-d580e4d92c91]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe681202-d3c6-41f3-9837-66b2b9524f8f]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:06:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:06:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5538cf3c-780e-45e9-ba85-496c6aedad83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69, portal: 172.16.0.220,3260]
Aug 26 12:06:37 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69, portal: 172.16.0.220,3260] successful.
Aug 26 12:06:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7052f1be-1b91-4556-9804-2b8a01283994]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aa06dd-ed45-4b83-815a-6d385a914133]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:06:37 user nova-compute[73068]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:06:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:06:37 user nova-compute[73068]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:06:37 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbbc935-e7bb-421b-a30c-3cb17295a4b9]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:06:37 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:06:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-bc315184-182f-4229-bbeb-a479c093afa6 req-31fd8973-7cf2-4fad-b3c1-bace973d47cc service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Received event network-vif-plugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:06:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bc315184-182f-4229-bbeb-a479c093afa6 req-31fd8973-7cf2-4fad-b3c1-bace973d47cc service nova] Acquiring lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bc315184-182f-4229-bbeb-a479c093afa6 req-31fd8973-7cf2-4fad-b3c1-bace973d47cc service nova] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bc315184-182f-4229-bbeb-a479c093afa6 req-31fd8973-7cf2-4fad-b3c1-bace973d47cc service nova] Lock "b148f5b5-ada4-49a6-9e9c-cd04283223ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-bc315184-182f-4229-bbeb-a479c093afa6 req-31fd8973-7cf2-4fad-b3c1-bace973d47cc service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] No waiting events found dispatching network-vif-plugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:06:38 user nova-compute[73068]: WARNING nova.compute.manager [req-bc315184-182f-4229-bbeb-a479c093afa6 req-31fd8973-7cf2-4fad-b3c1-bace973d47cc service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Received unexpected event network-vif-plugged-9a6af2c1-2262-4553-bd47-ac5f57131fdc for instance with vm_state deleted and task_state None.
Aug 26 12:06:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-bc315184-182f-4229-bbeb-a479c093afa6 req-31fd8973-7cf2-4fad-b3c1-bace973d47cc service nova] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Received event network-vif-deleted-9a6af2c1-2262-4553-bd47-ac5f57131fdc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:06:38 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:06:38 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npKiyNow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:06:38 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:06:38 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23362373735646563', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:06:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362373735646563', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1188475010',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1188475010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1188475010',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdSvtv5LXnhTuXLJRIetq8ApdO8suqDJH3EjtkbkeVfjk5BI5fS0NV/K+9Y1fYFI/azM7NpQGLVx0DB4QDXYv+/3DcSkThvpGJhUAVybEgwuj+CaI37iArAfjSHo8I7Kg==',key_name='tempest-keypair-550479659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-tl7pcyk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7914d369aa429394c647f73846fe5a',uuid=3d1a9d9e-10d7-495d-8cdf-d2470ca185ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:9b:d9,bridge_name='br-int',has_traffic_filtering=True,id=d4f80623-0b79-4f2a-9ae1-577141459f97,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f80623-0b') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG nova.objects.instance [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:06:39 user nova-compute[73068]:   <uuid>3d1a9d9e-10d7-495d-8cdf-d2470ca185ee</uuid>
Aug 26 12:06:39 user nova-compute[73068]:   <name>instance-0000002d</name>
Aug 26 12:06:39 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:06:39 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:06:39 user nova-compute[73068]:   <metadata>
Aug 26 12:06:39 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:06:39 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:06:39 user nova-compute[73068]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1188475010</nova:name>
Aug 26 12:06:39 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:06:37</nova:creationTime>
Aug 26 12:06:39 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:06:39 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:06:39 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:06:39 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:06:39 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:06:39 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:06:39 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:06:39 user nova-compute[73068]:       <nova:owner>
Aug 26 12:06:39 user nova-compute[73068]:         <nova:user uuid="1c7914d369aa429394c647f73846fe5a">tempest-TestVolumeBootPattern-731970169-project-member</nova:user>
Aug 26 12:06:39 user nova-compute[73068]:         <nova:project uuid="681694efee294a74b277fced3266643d">tempest-TestVolumeBootPattern-731970169</nova:project>
Aug 26 12:06:39 user nova-compute[73068]:       </nova:owner>
Aug 26 12:06:39 user nova-compute[73068]:       <nova:ports>
Aug 26 12:06:39 user nova-compute[73068]:         <nova:port uuid="d4f80623-0b79-4f2a-9ae1-577141459f97">
Aug 26 12:06:39 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 12:06:39 user nova-compute[73068]:         </nova:port>
Aug 26 12:06:39 user nova-compute[73068]:       </nova:ports>
Aug 26 12:06:39 user nova-compute[73068]:     </nova:instance>
Aug 26 12:06:39 user nova-compute[73068]:   </metadata>
Aug 26 12:06:39 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:06:39 user nova-compute[73068]:     <system>
Aug 26 12:06:39 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:06:39 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:06:39 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:06:39 user nova-compute[73068]:       <entry name="serial">3d1a9d9e-10d7-495d-8cdf-d2470ca185ee</entry>
Aug 26 12:06:39 user nova-compute[73068]:       <entry name="uuid">3d1a9d9e-10d7-495d-8cdf-d2470ca185ee</entry>
Aug 26 12:06:39 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:06:39 user nova-compute[73068]:     </system>
Aug 26 12:06:39 user nova-compute[73068]:   </sysinfo>
Aug 26 12:06:39 user nova-compute[73068]:   <os>
Aug 26 12:06:39 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:06:39 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:06:39 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:06:39 user nova-compute[73068]:   </os>
Aug 26 12:06:39 user nova-compute[73068]:   <features>
Aug 26 12:06:39 user nova-compute[73068]:     <acpi/>
Aug 26 12:06:39 user nova-compute[73068]:     <apic/>
Aug 26 12:06:39 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:06:39 user nova-compute[73068]:   </features>
Aug 26 12:06:39 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:06:39 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:06:39 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:06:39 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:06:39 user nova-compute[73068]:   </clock>
Aug 26 12:06:39 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:06:39 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:06:39 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:06:39 user nova-compute[73068]:   </cpu>
Aug 26 12:06:39 user nova-compute[73068]:   <devices>
Aug 26 12:06:39 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 12:06:39 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:06:39 user nova-compute[73068]:       <source dev="/dev/sdc"/>
Aug 26 12:06:39 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:06:39 user nova-compute[73068]:       <serial>f2830e16-7de3-4f65-b6df-95a825b95c69</serial>
Aug 26 12:06:39 user nova-compute[73068]:     </disk>
Aug 26 12:06:39 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:06:39 user nova-compute[73068]:       <mac address="fa:16:3e:03:9b:d9"/>
Aug 26 12:06:39 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:06:39 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:06:39 user nova-compute[73068]:       <target dev="tapd4f80623-0b"/>
Aug 26 12:06:39 user nova-compute[73068]:     </interface>
Aug 26 12:06:39 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:06:39 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/3d1a9d9e-10d7-495d-8cdf-d2470ca185ee/console.log" append="off"/>
Aug 26 12:06:39 user nova-compute[73068]:     </serial>
Aug 26 12:06:39 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:06:39 user nova-compute[73068]:     <video>
Aug 26 12:06:39 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:06:39 user nova-compute[73068]:     </video>
Aug 26 12:06:39 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:06:39 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:06:39 user nova-compute[73068]:     </rng>
Aug 26 12:06:39 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:06:39 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:06:39 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:06:39 user nova-compute[73068]:     </memballoon>
Aug 26 12:06:39 user nova-compute[73068]:   </devices>
Aug 26 12:06:39 user nova-compute[73068]: </domain>
Aug 26 12:06:39 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1188475010',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1188475010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1188475010',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdSvtv5LXnhTuXLJRIetq8ApdO8suqDJH3EjtkbkeVfjk5BI5fS0NV/K+9Y1fYFI/azM7NpQGLVx0DB4QDXYv+/3DcSkThvpGJhUAVybEgwuj+CaI37iArAfjSHo8I7Kg==',key_name='tempest-keypair-550479659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-tl7pcyk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:06:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7914d369aa429394c647f73846fe5a',uuid=3d1a9d9e-10d7-495d-8cdf-d2470ca185ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:9b:d9,bridge_name='br-int',has_traffic_filtering=True,id=d4f80623-0b79-4f2a-9ae1-577141459f97,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f80623-0b') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG os_vif [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:9b:d9,bridge_name='br-int',has_traffic_filtering=True,id=d4f80623-0b79-4f2a-9ae1-577141459f97,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f80623-0b') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4f80623-0b, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4f80623-0b, col_values=(('external_ids', {'iface-id': 'd4f80623-0b79-4f2a-9ae1-577141459f97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:9b:d9', 'vm-uuid': '3d1a9d9e-10d7-495d-8cdf-d2470ca185ee'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:39 user nova-compute[73068]: INFO os_vif [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:9b:d9,bridge_name='br-int',has_traffic_filtering=True,id=d4f80623-0b79-4f2a-9ae1-577141459f97,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f80623-0b')
Aug 26 12:06:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:06:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No VIF found with MAC fa:16:3e:03:9b:d9, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:06:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-bddb5d42-9336-46f4-b5a0-2714b1b91408 req-34142146-ecbb-40d4-af88-9dc1f46882a5 service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Received event network-vif-plugged-d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:06:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bddb5d42-9336-46f4-b5a0-2714b1b91408 req-34142146-ecbb-40d4-af88-9dc1f46882a5 service nova] Acquiring lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bddb5d42-9336-46f4-b5a0-2714b1b91408 req-34142146-ecbb-40d4-af88-9dc1f46882a5 service nova] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-bddb5d42-9336-46f4-b5a0-2714b1b91408 req-34142146-ecbb-40d4-af88-9dc1f46882a5 service nova] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:40 user nova-compute[73068]: DEBUG nova.compute.manager [req-bddb5d42-9336-46f4-b5a0-2714b1b91408 req-34142146-ecbb-40d4-af88-9dc1f46882a5 service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] No waiting events found dispatching network-vif-plugged-d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:06:40 user nova-compute[73068]: WARNING nova.compute.manager [req-bddb5d42-9336-46f4-b5a0-2714b1b91408 req-34142146-ecbb-40d4-af88-9dc1f46882a5 service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Received unexpected event network-vif-plugged-d4f80623-0b79-4f2a-9ae1-577141459f97 for instance with vm_state building and task_state spawning.
Aug 26 12:06:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051602.421557, 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:06:42 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] VM Resumed (Lifecycle Event)
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:06:42 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Instance spawned successfully.
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:06:42 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051602.4226394, 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:06:42 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] VM Started (Lifecycle Event)
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:06:42 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:06:42 user nova-compute[73068]: INFO nova.compute.manager [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-9bcf5bfb-b32c-4ad0-b6fe-0a47c89f79e4 req-703cbaff-81ad-49d5-b244-65eb8010283e service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Received event network-vif-plugged-d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9bcf5bfb-b32c-4ad0-b6fe-0a47c89f79e4 req-703cbaff-81ad-49d5-b244-65eb8010283e service nova] Acquiring lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9bcf5bfb-b32c-4ad0-b6fe-0a47c89f79e4 req-703cbaff-81ad-49d5-b244-65eb8010283e service nova] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9bcf5bfb-b32c-4ad0-b6fe-0a47c89f79e4 req-703cbaff-81ad-49d5-b244-65eb8010283e service nova] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:42 user nova-compute[73068]: DEBUG nova.compute.manager [req-9bcf5bfb-b32c-4ad0-b6fe-0a47c89f79e4 req-703cbaff-81ad-49d5-b244-65eb8010283e service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] No waiting events found dispatching network-vif-plugged-d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:06:42 user nova-compute[73068]: WARNING nova.compute.manager [req-9bcf5bfb-b32c-4ad0-b6fe-0a47c89f79e4 req-703cbaff-81ad-49d5-b244-65eb8010283e service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Received unexpected event network-vif-plugged-d4f80623-0b79-4f2a-9ae1-577141459f97 for instance with vm_state building and task_state spawning.
Aug 26 12:06:42 user nova-compute[73068]: INFO nova.compute.manager [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Took 16.25 seconds to build instance.
Aug 26 12:06:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f5492c88-7131-449a-ae7a-145469ff41a7 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.344s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:06:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:49 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:51 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051596.5801437, b148f5b5-ada4-49a6-9e9c-cd04283223ee => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:06:51 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] VM Stopped (Lifecycle Event)
Aug 26 12:06:51 user nova-compute[73068]: DEBUG nova.compute.manager [None req-d8d8e09c-9928-4d98-ab00-dbac820495d5 None None] [instance: b148f5b5-ada4-49a6-9e9c-cd04283223ee] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:06:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:06:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:06:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:06:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:06:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:06:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:04 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:07:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:07:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:07:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:07:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:07:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8393MB free_disk=25.120147705078125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance ae831c2e-a761-4cda-95ae-9476705baa5e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:07:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:07:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:14 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:07:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:07:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:07:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:07:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:07:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:07:15 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 2011f764-7057-43ba-ba00-834376cc968e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:07:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updating instance_info_cache with network_info: [{"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:07:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-2011f764-7057-43ba-ba00-834376cc968e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:07:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:07:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:07:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:07:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:07:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:07:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:07:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:07:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:07:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:07:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:07:26 user nova-compute[73068]: INFO nova.compute.manager [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Terminating instance
Aug 26 12:07:26 user nova-compute[73068]: DEBUG nova.compute.manager [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-990bb747-b0eb-4470-b4f4-b88ef4d281f9 req-db0afd8b-0097-4f94-b214-a519135ba8e7 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-unplugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-990bb747-b0eb-4470-b4f4-b88ef4d281f9 req-db0afd8b-0097-4f94-b214-a519135ba8e7 service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-990bb747-b0eb-4470-b4f4-b88ef4d281f9 req-db0afd8b-0097-4f94-b214-a519135ba8e7 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-990bb747-b0eb-4470-b4f4-b88ef4d281f9 req-db0afd8b-0097-4f94-b214-a519135ba8e7 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-990bb747-b0eb-4470-b4f4-b88ef4d281f9 req-db0afd8b-0097-4f94-b214-a519135ba8e7 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-unplugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:07:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-990bb747-b0eb-4470-b4f4-b88ef4d281f9 req-db0afd8b-0097-4f94-b214-a519135ba8e7 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-unplugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:27 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Instance destroyed successfully.
Aug 26 12:07:27 user nova-compute[73068]: DEBUG nova.objects.instance [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'resources' on Instance uuid ae831c2e-a761-4cda-95ae-9476705baa5e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:51:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1928814755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1928814755',id=34,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:53:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-xl4lhper',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:55:25Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=ae831c2e-a761-4cda-95ae-9476705baa5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "7c7fbd06-9335-4a5c-b050-689da6247962", "address": "fa:16:3e:0d:03:59", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7fbd06-93", "ovs_interfaceid": "7c7fbd06-9335-4a5c-b050-689da6247962", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:03:59,bridge_name='br-int',has_traffic_filtering=True,id=7c7fbd06-9335-4a5c-b050-689da6247962,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7fbd06-93') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_vif [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:03:59,bridge_name='br-int',has_traffic_filtering=True,id=7c7fbd06-9335-4a5c-b050-689da6247962,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7fbd06-93') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c7fbd06-93, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:27 user nova-compute[73068]: INFO os_vif [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:03:59,bridge_name='br-int',has_traffic_filtering=True,id=7c7fbd06-9335-4a5c-b050-689da6247962,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7fbd06-93')
Aug 26 12:07:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JkRuOdBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:07:27 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b1d6d3-4547-43e8-bbfd-e57f2b43f4c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e797afa-32b2-4551-b058-85ec4a9aaa0d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:07:27 user nova-compute[73068]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:07:27 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b (non-flash)
Aug 26 12:07:27 user nova-compute[73068]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:07:27 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd90192e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c37999f-a88c-403f-bc44-eec1b2276922]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bdd686-6bb3-4065-9707-0e2ceeaec8e2]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[afea71d9-1b7f-4077-881f-4f074e52aa93]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c758a43-8d0a-4c64-8e63-aa923fbe018e]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[71961725-81e9-45c8-81fa-65fbbac7c625]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5108dc02-3fee-4f5c-b02e-ccacc66774e9]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b, portal: 172.16.0.220,3260]
Aug 26 12:07:27 user nova-compute[73068]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b, portal: 172.16.0.220,3260] successful.
Aug 26 12:07:27 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f84ea73e-cf16-409a-81e3-1883a918839b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca82a5d9-f91a-4859-91d1-22377695b258]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] <== disconnect_volume: return (267ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:07:27 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Deleting instance files /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e_del
Aug 26 12:07:27 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Deletion of /opt/stack/data/nova/instances/ae831c2e-a761-4cda-95ae-9476705baa5e_del complete
Aug 26 12:07:27 user nova-compute[73068]: INFO nova.compute.manager [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 26 12:07:27 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:07:27 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:07:28 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:07:28 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Took 0.79 seconds to deallocate network for instance.
Aug 26 12:07:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-231f987c-abab-4f97-b67b-626ab3fd60cb req-423c786e-37c6-4908-a834-a0af10a4a615 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:07:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-231f987c-abab-4f97-b67b-626ab3fd60cb req-423c786e-37c6-4908-a834-a0af10a4a615 service nova] Acquiring lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:07:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-231f987c-abab-4f97-b67b-626ab3fd60cb req-423c786e-37c6-4908-a834-a0af10a4a615 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:07:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-231f987c-abab-4f97-b67b-626ab3fd60cb req-423c786e-37c6-4908-a834-a0af10a4a615 service nova] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:07:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-231f987c-abab-4f97-b67b-626ab3fd60cb req-423c786e-37c6-4908-a834-a0af10a4a615 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] No waiting events found dispatching network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:07:28 user nova-compute[73068]: WARNING nova.compute.manager [req-231f987c-abab-4f97-b67b-626ab3fd60cb req-423c786e-37c6-4908-a834-a0af10a4a615 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received unexpected event network-vif-plugged-7c7fbd06-9335-4a5c-b050-689da6247962 for instance with vm_state active and task_state deleting.
Aug 26 12:07:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-231f987c-abab-4f97-b67b-626ab3fd60cb req-423c786e-37c6-4908-a834-a0af10a4a615 service nova] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Received event network-vif-deleted-7c7fbd06-9335-4a5c-b050-689da6247962 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:07:29 user nova-compute[73068]: INFO nova.compute.manager [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Took 0.79 seconds to detach 1 volumes for instance.
Aug 26 12:07:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:07:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:07:29 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:07:29 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:07:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:07:29 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Deleted allocations for instance ae831c2e-a761-4cda-95ae-9476705baa5e
Aug 26 12:07:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-90061206-37d8-4345-a874-cad82a700557 tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "ae831c2e-a761-4cda-95ae-9476705baa5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.112s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:07:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:07:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:07:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:07:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:07:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:07:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:42 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051647.1117494, ae831c2e-a761-4cda-95ae-9476705baa5e => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:07:42 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] VM Stopped (Lifecycle Event)
Aug 26 12:07:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e67808f6-d15d-465b-b861-41198cf5c685 None None] [instance: ae831c2e-a761-4cda-95ae-9476705baa5e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:07:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:07:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:58 user nova-compute[73068]: INFO nova.compute.manager [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Rescuing
Aug 26 12:07:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:07:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquired lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:07:58 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:07:59 user nova-compute[73068]: DEBUG nova.network.neutron [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updating instance_info_cache with network_info: [{"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:07:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Releasing lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:07:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:07:59 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-754bbdf1-1435-45db-940c-8394cf5af881 req-c358bc0a-5ae1-40ca-a953-e9eff5f41c65 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-754bbdf1-1435-45db-940c-8394cf5af881 req-c358bc0a-5ae1-40ca-a953-e9eff5f41c65 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-754bbdf1-1435-45db-940c-8394cf5af881 req-c358bc0a-5ae1-40ca-a953-e9eff5f41c65 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-754bbdf1-1435-45db-940c-8394cf5af881 req-c358bc0a-5ae1-40ca-a953-e9eff5f41c65 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.compute.manager [req-754bbdf1-1435-45db-940c-8394cf5af881 req-c358bc0a-5ae1-40ca-a953-e9eff5f41c65 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:00 user nova-compute[73068]: WARNING nova.compute.manager [req-754bbdf1-1435-45db-940c-8394cf5af881 req-c358bc0a-5ae1-40ca-a953-e9eff5f41c65 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state active and task_state rescuing.
Aug 26 12:08:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:00 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Instance destroyed successfully.
Aug 26 12:08:00 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Attempting rescue
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73068) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Instance directory exists: not creating {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 12:08:00 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Creating image(s)
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.rescue {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.rescue" returned: 0 in 0.065s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'migration_context' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.objects.base [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<4e21d114-7d6c-4a4a-ab2e-51e7d169fc81> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Start _get_guest_xml network_info=[{"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "vif_mac": "fa:16:3e:55:54:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'resources' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.objects.base [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<4e21d114-7d6c-4a4a-ab2e-51e7d169fc81> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'numa_topology' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.objects.base [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<4e21d114-7d6c-4a4a-ab2e-51e7d169fc81> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:08:00 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:08:00 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:08:00 user nova-compute[73068]: DEBUG nova.objects.base [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<4e21d114-7d6c-4a4a-ab2e-51e7d169fc81> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:08:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-644189681',display_name='tempest-ServerRescueNegativeTestJSON-server-644189681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-644189681',id=42,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-pykyh5j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:03:22Z,user_data=None,user_id='39a8587c93764774ac04c74f11ed6498',uuid=4e21d114-7d6c-4a4a-ab2e-51e7d169fc81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "vif_mac": "fa:16:3e:55:54:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:08:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "vif_mac": "fa:16:3e:55:54:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:08:01 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:54:54,bridge_name='br-int',has_traffic_filtering=True,id=df8b5dfa-bb92-47f7-bb60-cb6aee769aa8,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8b5dfa-bb') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:08:01 user nova-compute[73068]: DEBUG nova.objects.instance [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:08:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:01 user nova-compute[73068]: DEBUG nova.objects.base [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<4e21d114-7d6c-4a4a-ab2e-51e7d169fc81> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:08:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:08:01 user nova-compute[73068]:   <uuid>4e21d114-7d6c-4a4a-ab2e-51e7d169fc81</uuid>
Aug 26 12:08:01 user nova-compute[73068]:   <name>instance-0000002a</name>
Aug 26 12:08:01 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:08:01 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:08:01 user nova-compute[73068]:   <metadata>
Aug 26 12:08:01 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:08:01 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:08:01 user nova-compute[73068]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-644189681</nova:name>
Aug 26 12:08:01 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:08:00</nova:creationTime>
Aug 26 12:08:01 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:08:01 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:08:01 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:08:01 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:08:01 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:08:01 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:08:01 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:08:01 user nova-compute[73068]:       <nova:owner>
Aug 26 12:08:01 user nova-compute[73068]:         <nova:user uuid="39a8587c93764774ac04c74f11ed6498">tempest-ServerRescueNegativeTestJSON-982037839-project-member</nova:user>
Aug 26 12:08:01 user nova-compute[73068]:         <nova:project uuid="89262659b6e249969ee0edb7cd482d1f">tempest-ServerRescueNegativeTestJSON-982037839</nova:project>
Aug 26 12:08:01 user nova-compute[73068]:       </nova:owner>
Aug 26 12:08:01 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 12:08:01 user nova-compute[73068]:       <nova:ports>
Aug 26 12:08:01 user nova-compute[73068]:         <nova:port uuid="df8b5dfa-bb92-47f7-bb60-cb6aee769aa8">
Aug 26 12:08:01 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 12:08:01 user nova-compute[73068]:         </nova:port>
Aug 26 12:08:01 user nova-compute[73068]:       </nova:ports>
Aug 26 12:08:01 user nova-compute[73068]:     </nova:instance>
Aug 26 12:08:01 user nova-compute[73068]:   </metadata>
Aug 26 12:08:01 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:08:01 user nova-compute[73068]:     <system>
Aug 26 12:08:01 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:08:01 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:08:01 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:08:01 user nova-compute[73068]:       <entry name="serial">4e21d114-7d6c-4a4a-ab2e-51e7d169fc81</entry>
Aug 26 12:08:01 user nova-compute[73068]:       <entry name="uuid">4e21d114-7d6c-4a4a-ab2e-51e7d169fc81</entry>
Aug 26 12:08:01 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:08:01 user nova-compute[73068]:     </system>
Aug 26 12:08:01 user nova-compute[73068]:   </sysinfo>
Aug 26 12:08:01 user nova-compute[73068]:   <os>
Aug 26 12:08:01 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:08:01 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:08:01 user nova-compute[73068]:   </os>
Aug 26 12:08:01 user nova-compute[73068]:   <features>
Aug 26 12:08:01 user nova-compute[73068]:     <acpi/>
Aug 26 12:08:01 user nova-compute[73068]:     <apic/>
Aug 26 12:08:01 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:08:01 user nova-compute[73068]:   </features>
Aug 26 12:08:01 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:08:01 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:08:01 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:08:01 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:08:01 user nova-compute[73068]:   </clock>
Aug 26 12:08:01 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:08:01 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:08:01 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:08:01 user nova-compute[73068]:   </cpu>
Aug 26 12:08:01 user nova-compute[73068]:   <devices>
Aug 26 12:08:01 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:08:01 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:08:01 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.rescue"/>
Aug 26 12:08:01 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:08:01 user nova-compute[73068]:     </disk>
Aug 26 12:08:01 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:08:01 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:08:01 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk"/>
Aug 26 12:08:01 user nova-compute[73068]:       <target dev="vdb" bus="virtio"/>
Aug 26 12:08:01 user nova-compute[73068]:     </disk>
Aug 26 12:08:01 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:08:01 user nova-compute[73068]:       <mac address="fa:16:3e:55:54:54"/>
Aug 26 12:08:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:08:01 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:08:01 user nova-compute[73068]:       <target dev="tapdf8b5dfa-bb"/>
Aug 26 12:08:01 user nova-compute[73068]:     </interface>
Aug 26 12:08:01 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:08:01 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/console.log" append="off"/>
Aug 26 12:08:01 user nova-compute[73068]:     </serial>
Aug 26 12:08:01 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:08:01 user nova-compute[73068]:     <video>
Aug 26 12:08:01 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:08:01 user nova-compute[73068]:     </video>
Aug 26 12:08:01 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:08:01 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:08:01 user nova-compute[73068]:     </rng>
Aug 26 12:08:01 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:08:01 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:08:01 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:08:01 user nova-compute[73068]:     </memballoon>
Aug 26 12:08:01 user nova-compute[73068]:   </devices>
Aug 26 12:08:01 user nova-compute[73068]: </domain>
Aug 26 12:08:01 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:08:01 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Instance destroyed successfully.
Aug 26 12:08:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:08:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:08:01 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No VIF found with MAC fa:16:3e:55:54:54, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:02 user nova-compute[73068]: WARNING nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state active and task_state rescuing.
Aug 26 12:08:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:02 user nova-compute[73068]: WARNING nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state active and task_state rescuing.
Aug 26 12:08:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:02 user nova-compute[73068]: WARNING nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state active and task_state rescuing.
Aug 26 12:08:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:02 user nova-compute[73068]: WARNING nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state active and task_state rescuing.
Aug 26 12:08:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:02 user nova-compute[73068]: WARNING nova.compute.manager [req-dd81777d-d5ad-4eb0-8166-798b16e311d8 req-a2e852ff-75d0-49a6-88c7-8bb12baf5ea6 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state active and task_state rescuing.
Aug 26 12:08:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.compute.manager [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.compute.manager [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:04 user nova-compute[73068]: WARNING nova.compute.manager [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state active and task_state rescuing.
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.compute.manager [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.compute.manager [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:04 user nova-compute[73068]: WARNING nova.compute.manager [req-ed902ce0-4607-44b4-9c96-0c53ae1b66c9 req-0cbad1a9-055c-42d7-a9b4-54e008832376 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state active and task_state rescuing.
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051684.652716, 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:08:04 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] VM Resumed (Lifecycle Event)
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-e07254d5-e842-46b1-94e3-8baca6db3593 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:08:04 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051684.6539817, 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:08:04 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] VM Started (Lifecycle Event)
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:08:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:08:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:08:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:08:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:08:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:08:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:08:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8378MB free_disk=25.11827850341797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 2011f764-7057-43ba-ba00-834376cc968e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 12:08:13 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 12:08:14 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 12:08:14 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 12:08:14 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:08:14 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:08:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:08:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:08:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:08:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:08:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:08:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updating instance_info_cache with network_info: [{"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:08:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:08:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:08:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "2011f764-7057-43ba-ba00-834376cc968e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "2011f764-7057-43ba-ba00-834376cc968e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "2011f764-7057-43ba-ba00-834376cc968e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "2011f764-7057-43ba-ba00-834376cc968e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "2011f764-7057-43ba-ba00-834376cc968e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:17 user nova-compute[73068]: INFO nova.compute.manager [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Terminating instance
Aug 26 12:08:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-db0e8998-c4cc-4e9b-acfb-1970d2add7a6 req-e5570490-c32e-4d3c-9efc-9981caacc9ae service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Received event network-changed-d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-db0e8998-c4cc-4e9b-acfb-1970d2add7a6 req-e5570490-c32e-4d3c-9efc-9981caacc9ae service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Refreshing instance network info cache due to event network-changed-d4f80623-0b79-4f2a-9ae1-577141459f97. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-db0e8998-c4cc-4e9b-acfb-1970d2add7a6 req-e5570490-c32e-4d3c-9efc-9981caacc9ae service nova] Acquiring lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-db0e8998-c4cc-4e9b-acfb-1970d2add7a6 req-e5570490-c32e-4d3c-9efc-9981caacc9ae service nova] Acquired lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG nova.network.neutron [req-db0e8998-c4cc-4e9b-acfb-1970d2add7a6 req-e5570490-c32e-4d3c-9efc-9981caacc9ae service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Refreshing network info cache for port d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-befd5e0d-eed9-4b38-9473-15d269867c95 req-d14589bb-3cb7-4d53-8b1b-abd512f4c999 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Received event network-vif-unplugged-78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-befd5e0d-eed9-4b38-9473-15d269867c95 req-d14589bb-3cb7-4d53-8b1b-abd512f4c999 service nova] Acquiring lock "2011f764-7057-43ba-ba00-834376cc968e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-befd5e0d-eed9-4b38-9473-15d269867c95 req-d14589bb-3cb7-4d53-8b1b-abd512f4c999 service nova] Lock "2011f764-7057-43ba-ba00-834376cc968e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-befd5e0d-eed9-4b38-9473-15d269867c95 req-d14589bb-3cb7-4d53-8b1b-abd512f4c999 service nova] Lock "2011f764-7057-43ba-ba00-834376cc968e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-befd5e0d-eed9-4b38-9473-15d269867c95 req-d14589bb-3cb7-4d53-8b1b-abd512f4c999 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] No waiting events found dispatching network-vif-unplugged-78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG nova.compute.manager [req-befd5e0d-eed9-4b38-9473-15d269867c95 req-d14589bb-3cb7-4d53-8b1b-abd512f4c999 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Received event network-vif-unplugged-78c12ef4-3a49-41b6-8efd-1db50299574a for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:08:17 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Instance destroyed successfully.
Aug 26 12:08:17 user nova-compute[73068]: DEBUG nova.objects.instance [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lazy-loading 'resources' on Instance uuid 2011f764-7057-43ba-ba00-834376cc968e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T11:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1645402505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1645402505',id=31,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T11:48:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20a527043d44250bfe0a4b9dbf3e00d',ramdisk_id='',reservation_id='r-kh0094v9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343541457',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T11:50:35Z,user_data=None,user_id='9cd2bf96810a4540969277c8f94d5a6d',uuid=2011f764-7057-43ba-ba00-834376cc968e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converting VIF {"id": "78c12ef4-3a49-41b6-8efd-1db50299574a", "address": "fa:16:3e:94:7a:80", "network": {"id": "34ed056e-8626-4f0d-8317-64c788284223", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1006854401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a527043d44250bfe0a4b9dbf3e00d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78c12ef4-3a", "ovs_interfaceid": "78c12ef4-3a49-41b6-8efd-1db50299574a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:7a:80,bridge_name='br-int',has_traffic_filtering=True,id=78c12ef4-3a49-41b6-8efd-1db50299574a,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c12ef4-3a') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:08:17 user nova-compute[73068]: DEBUG os_vif [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:7a:80,bridge_name='br-int',has_traffic_filtering=True,id=78c12ef4-3a49-41b6-8efd-1db50299574a,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c12ef4-3a') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:08:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78c12ef4-3a, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:08:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:08:18 user nova-compute[73068]: INFO os_vif [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:7a:80,bridge_name='br-int',has_traffic_filtering=True,id=78c12ef4-3a49-41b6-8efd-1db50299574a,network=Network(34ed056e-8626-4f0d-8317-64c788284223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78c12ef4-3a')
Aug 26 12:08:18 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Deleting instance files /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e_del
Aug 26 12:08:18 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Deletion of /opt/stack/data/nova/instances/2011f764-7057-43ba-ba00-834376cc968e_del complete
Aug 26 12:08:18 user nova-compute[73068]: INFO nova.compute.manager [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 12:08:18 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:08:18 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:08:18 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 2011f764-7057-43ba-ba00-834376cc968e] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:08:18 user nova-compute[73068]: DEBUG nova.network.neutron [req-db0e8998-c4cc-4e9b-acfb-1970d2add7a6 req-e5570490-c32e-4d3c-9efc-9981caacc9ae service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Updated VIF entry in instance network info cache for port d4f80623-0b79-4f2a-9ae1-577141459f97. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:08:18 user nova-compute[73068]: DEBUG nova.network.neutron [req-db0e8998-c4cc-4e9b-acfb-1970d2add7a6 req-e5570490-c32e-4d3c-9efc-9981caacc9ae service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Updating instance_info_cache with network_info: [{"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:08:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-db0e8998-c4cc-4e9b-acfb-1970d2add7a6 req-e5570490-c32e-4d3c-9efc-9981caacc9ae service nova] Releasing lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:08:19 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Took 1.00 seconds to deallocate network for instance.
Aug 26 12:08:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:19 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Deleted allocations for instance 2011f764-7057-43ba-ba00-834376cc968e
Aug 26 12:08:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7c254e86-8ddb-4311-a136-4f7efddc58bd tempest-ServerBootFromVolumeStableRescueTest-343541457 tempest-ServerBootFromVolumeStableRescueTest-343541457-project-member] Lock "2011f764-7057-43ba-ba00-834376cc968e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.218s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-3748bd32-e9e0-4956-ac1d-e74277ba1d9f req-09dd2367-755d-4703-802c-21fa75c3851c service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Received event network-vif-deleted-78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-471cd97d-19c3-4b40-a819-4c86f599874c req-c080ac06-c104-4271-a7c8-a506ffa1fb18 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Received event network-vif-plugged-78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-471cd97d-19c3-4b40-a819-4c86f599874c req-c080ac06-c104-4271-a7c8-a506ffa1fb18 service nova] Acquiring lock "2011f764-7057-43ba-ba00-834376cc968e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-471cd97d-19c3-4b40-a819-4c86f599874c req-c080ac06-c104-4271-a7c8-a506ffa1fb18 service nova] Lock "2011f764-7057-43ba-ba00-834376cc968e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-471cd97d-19c3-4b40-a819-4c86f599874c req-c080ac06-c104-4271-a7c8-a506ffa1fb18 service nova] Lock "2011f764-7057-43ba-ba00-834376cc968e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-471cd97d-19c3-4b40-a819-4c86f599874c req-c080ac06-c104-4271-a7c8-a506ffa1fb18 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] No waiting events found dispatching network-vif-plugged-78c12ef4-3a49-41b6-8efd-1db50299574a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:19 user nova-compute[73068]: WARNING nova.compute.manager [req-471cd97d-19c3-4b40-a819-4c86f599874c req-c080ac06-c104-4271-a7c8-a506ffa1fb18 service nova] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Received unexpected event network-vif-plugged-78c12ef4-3a49-41b6-8efd-1db50299574a for instance with vm_state deleted and task_state None.
Aug 26 12:08:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:21 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:27 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 12:08:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 12:08:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "57b07ad4-2f8b-4204-a885-d0bb18f02329" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:08:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:30 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:08:30 user nova-compute[73068]: INFO nova.compute.claims [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Claim successful on node user
Aug 26 12:08:30 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:08:30 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:08:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:08:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:08:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:08:30 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:08:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:08:30 user nova-compute[73068]: INFO nova.virt.block_device [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Booting with volume snapshot 61ac0145-8f54-4f68-a4be-5ee7effb9100 at /dev/vda
Aug 26 12:08:30 user nova-compute[73068]: DEBUG nova.policy [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c7914d369aa429394c647f73846fe5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681694efee294a74b277fced3266643d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:08:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:31 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Successfully created port: f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Successfully updated port: f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "refresh_cache-57b07ad4-2f8b-4204-a885-d0bb18f02329" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquired lock "refresh_cache-57b07ad4-2f8b-4204-a885-d0bb18f02329" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-13b935fa-15d1-4987-a9bc-e7d5fff7d152 req-f7282810-8549-4cac-bf17-2a4586e2e8b3 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-changed-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-13b935fa-15d1-4987-a9bc-e7d5fff7d152 req-f7282810-8549-4cac-bf17-2a4586e2e8b3 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Refreshing instance network info cache due to event network-changed-f7896db0-ecb3-4b68-a4a1-846d12f21b83. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-13b935fa-15d1-4987-a9bc-e7d5fff7d152 req-f7282810-8549-4cac-bf17-2a4586e2e8b3 service nova] Acquiring lock "refresh_cache-57b07ad4-2f8b-4204-a885-d0bb18f02329" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Updating instance_info_cache with network_info: [{"id": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "address": "fa:16:3e:b4:20:eb", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7896db0-ec", "ovs_interfaceid": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Releasing lock "refresh_cache-57b07ad4-2f8b-4204-a885-d0bb18f02329" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Instance network_info: |[{"id": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "address": "fa:16:3e:b4:20:eb", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7896db0-ec", "ovs_interfaceid": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-13b935fa-15d1-4987-a9bc-e7d5fff7d152 req-f7282810-8549-4cac-bf17-2a4586e2e8b3 service nova] Acquired lock "refresh_cache-57b07ad4-2f8b-4204-a885-d0bb18f02329" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG nova.network.neutron [req-13b935fa-15d1-4987-a9bc-e7d5fff7d152 req-f7282810-8549-4cac-bf17-2a4586e2e8b3 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Refreshing network info cache for port f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:08:32 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051697.9746969, 2011f764-7057-43ba-ba00-834376cc968e => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:08:32 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 2011f764-7057-43ba-ba00-834376cc968e] VM Stopped (Lifecycle Event)
Aug 26 12:08:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-1c7fe523-6cc8-4183-9054-5d8abd8fce65 None None] [instance: 2011f764-7057-43ba-ba00-834376cc968e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:08:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-13b935fa-15d1-4987-a9bc-e7d5fff7d152 req-f7282810-8549-4cac-bf17-2a4586e2e8b3 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Updated VIF entry in instance network info cache for port f7896db0-ecb3-4b68-a4a1-846d12f21b83. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:08:33 user nova-compute[73068]: DEBUG nova.network.neutron [req-13b935fa-15d1-4987-a9bc-e7d5fff7d152 req-f7282810-8549-4cac-bf17-2a4586e2e8b3 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Updating instance_info_cache with network_info: [{"id": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "address": "fa:16:3e:b4:20:eb", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7896db0-ec", "ovs_interfaceid": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:08:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-13b935fa-15d1-4987-a9bc-e7d5fff7d152 req-f7282810-8549-4cac-bf17-2a4586e2e8b3 service nova] Releasing lock "refresh_cache-57b07ad4-2f8b-4204-a885-d0bb18f02329" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:08:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:08:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG os_brick.utils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4061fbe-c092-4c52-8950-037504b922b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[61014eda-34b2-45ca-b7b6-badfc5a4d377]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc556fb-75f7-43b1-a71e-551984d83c26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8675fc-36da-4ccf-9ea9-fbf2d34b63e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:08:36 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:08:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce2c1f5-0f90-41ef-82fa-462576342017]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG os_brick.utils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:08:36 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Updating existing volume attachment record: 8a2955fe-1d7a-4f3f-acaf-27f87ae438db {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:08:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:08:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:08:54 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Creating image(s)
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Ensure instance console log exists: /opt/stack/data/nova/instances/57b07ad4-2f8b-4204-a885-d0bb18f02329/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Start _get_guest_xml network_info=[{"id": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "address": "fa:16:3e:b4:20:eb", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7896db0-ec", "ovs_interfaceid": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T12:08:19Z,direct_url=<?>,disk_format='qcow2',id=90a0a3b7-c2d6-421b-82c9-11e2a4947175,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1923461434',owner='681694efee294a74b277fced3266643d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T12:08:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '8a2955fe-1d7a-4f3f-acaf-27f87ae438db', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfhBgNWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '57b07ad4-2f8b-4204-a885-d0bb18f02329', 'attached_at': '', 'detached_at': '', 'volume_id': '82059710-a7c3-4db6-86f4-58b88e6dac47', 'serial': '82059710-a7c3-4db6-86f4-58b88e6dac47'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:08:54 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:08:54 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T12:08:19Z,direct_url=<?>,disk_format='qcow2',id=90a0a3b7-c2d6-421b-82c9-11e2a4947175,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1923461434',owner='681694efee294a74b277fced3266643d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T12:08:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfhBgNWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:08:54 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:08:54 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:08:54 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[00046a9e-8b0e-4842-af2a-c254d2c6fd87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:08:54 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe39b677-258a-407a-8173-aa6a509999dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47] added
Aug 26 12:08:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bacb60-1842-4e71-b2d2-9b338ae495c8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb203bfe-20df-49d7-865a-4cefc0a65d0e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfhBgNWk {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfhBgNWk" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5537ef8-d2aa-4198-adeb-a5017c8dac8f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfhBgNWk'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2478cea1-173f-451b-8ebc-3af7553a08f3]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c52e286-1eb8-40ab-a181-63284cf520be]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:08:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:08:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcae710-5895-4a16-8157-18f3cc8ff134]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47, portal: 172.16.0.220,3260]
Aug 26 12:08:54 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47, portal: 172.16.0.220,3260] successful.
Aug 26 12:08:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[04900def-8bff-494f-b1e3-fec4371a5f55]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baa6d5f-8293-4fb9-83f5-1f7cbe666050]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:08:54 user nova-compute[73068]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 (non-flash)
Aug 26 12:08:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:08:54 user nova-compute[73068]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 (non-flash)
Aug 26 12:08:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1e15e1-01dc-4b1e-9367-f632edd37cf5]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:08:54 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfhBgNWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23537613962373666', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537613962373666', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-802822401',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-802822401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-802822401',id=46,image_ref='90a0a3b7-c2d6-421b-82c9-11e2a4947175',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVoqmMsxATw625BpGRdVapVBJiwEylH+Z7FbCAm1cUoRBfoflLE6HmHSuNyWugrmtizXGlQGMLp3F4sB2Jcv6rS/AulQqLrBsVKP1Vz2QE8fMixPZOiR2JVAZxTbYSOBQ==',key_name='tempest-keypair-1884580120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-bpq36dg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-731970169',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:08:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7914d369aa429394c647f73846fe5a',uuid=57b07ad4-2f8b-4204-a885-d0bb18f02329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "address": "fa:16:3e:b4:20:eb", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7896db0-ec", "ovs_interfaceid": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "address": "fa:16:3e:b4:20:eb", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7896db0-ec", "ovs_interfaceid": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:20:eb,bridge_name='br-int',has_traffic_filtering=True,id=f7896db0-ecb3-4b68-a4a1-846d12f21b83,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7896db0-ec') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG nova.objects.instance [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'pci_devices' on Instance uuid 57b07ad4-2f8b-4204-a885-d0bb18f02329 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:08:55 user nova-compute[73068]:   <uuid>57b07ad4-2f8b-4204-a885-d0bb18f02329</uuid>
Aug 26 12:08:55 user nova-compute[73068]:   <name>instance-0000002e</name>
Aug 26 12:08:55 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:08:55 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:08:55 user nova-compute[73068]:   <metadata>
Aug 26 12:08:55 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:08:55 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:08:55 user nova-compute[73068]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-802822401</nova:name>
Aug 26 12:08:55 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:08:54</nova:creationTime>
Aug 26 12:08:55 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:08:55 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:08:55 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:08:55 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:08:55 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:08:55 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:08:55 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:08:55 user nova-compute[73068]:       <nova:owner>
Aug 26 12:08:55 user nova-compute[73068]:         <nova:user uuid="1c7914d369aa429394c647f73846fe5a">tempest-TestVolumeBootPattern-731970169-project-member</nova:user>
Aug 26 12:08:55 user nova-compute[73068]:         <nova:project uuid="681694efee294a74b277fced3266643d">tempest-TestVolumeBootPattern-731970169</nova:project>
Aug 26 12:08:55 user nova-compute[73068]:       </nova:owner>
Aug 26 12:08:55 user nova-compute[73068]:       <nova:root type="image" uuid="90a0a3b7-c2d6-421b-82c9-11e2a4947175"/>
Aug 26 12:08:55 user nova-compute[73068]:       <nova:ports>
Aug 26 12:08:55 user nova-compute[73068]:         <nova:port uuid="f7896db0-ecb3-4b68-a4a1-846d12f21b83">
Aug 26 12:08:55 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 12:08:55 user nova-compute[73068]:         </nova:port>
Aug 26 12:08:55 user nova-compute[73068]:       </nova:ports>
Aug 26 12:08:55 user nova-compute[73068]:     </nova:instance>
Aug 26 12:08:55 user nova-compute[73068]:   </metadata>
Aug 26 12:08:55 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:08:55 user nova-compute[73068]:     <system>
Aug 26 12:08:55 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:08:55 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:08:55 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:08:55 user nova-compute[73068]:       <entry name="serial">57b07ad4-2f8b-4204-a885-d0bb18f02329</entry>
Aug 26 12:08:55 user nova-compute[73068]:       <entry name="uuid">57b07ad4-2f8b-4204-a885-d0bb18f02329</entry>
Aug 26 12:08:55 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:08:55 user nova-compute[73068]:     </system>
Aug 26 12:08:55 user nova-compute[73068]:   </sysinfo>
Aug 26 12:08:55 user nova-compute[73068]:   <os>
Aug 26 12:08:55 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:08:55 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:08:55 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:08:55 user nova-compute[73068]:   </os>
Aug 26 12:08:55 user nova-compute[73068]:   <features>
Aug 26 12:08:55 user nova-compute[73068]:     <acpi/>
Aug 26 12:08:55 user nova-compute[73068]:     <apic/>
Aug 26 12:08:55 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:08:55 user nova-compute[73068]:   </features>
Aug 26 12:08:55 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:08:55 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:08:55 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:08:55 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:08:55 user nova-compute[73068]:   </clock>
Aug 26 12:08:55 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:08:55 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:08:55 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:08:55 user nova-compute[73068]:   </cpu>
Aug 26 12:08:55 user nova-compute[73068]:   <devices>
Aug 26 12:08:55 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 12:08:55 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:08:55 user nova-compute[73068]:       <source dev="/dev/sdb"/>
Aug 26 12:08:55 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:08:55 user nova-compute[73068]:       <serial>82059710-a7c3-4db6-86f4-58b88e6dac47</serial>
Aug 26 12:08:55 user nova-compute[73068]:     </disk>
Aug 26 12:08:55 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:08:55 user nova-compute[73068]:       <mac address="fa:16:3e:b4:20:eb"/>
Aug 26 12:08:55 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:08:55 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:08:55 user nova-compute[73068]:       <target dev="tapf7896db0-ec"/>
Aug 26 12:08:55 user nova-compute[73068]:     </interface>
Aug 26 12:08:55 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:08:55 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/57b07ad4-2f8b-4204-a885-d0bb18f02329/console.log" append="off"/>
Aug 26 12:08:55 user nova-compute[73068]:     </serial>
Aug 26 12:08:55 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:08:55 user nova-compute[73068]:     <video>
Aug 26 12:08:55 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:08:55 user nova-compute[73068]:     </video>
Aug 26 12:08:55 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:08:55 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:08:55 user nova-compute[73068]:     </rng>
Aug 26 12:08:55 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:08:55 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:08:55 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:08:55 user nova-compute[73068]:     </memballoon>
Aug 26 12:08:55 user nova-compute[73068]:   </devices>
Aug 26 12:08:55 user nova-compute[73068]: </domain>
Aug 26 12:08:55 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-802822401',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-802822401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-802822401',id=46,image_ref='90a0a3b7-c2d6-421b-82c9-11e2a4947175',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVoqmMsxATw625BpGRdVapVBJiwEylH+Z7FbCAm1cUoRBfoflLE6HmHSuNyWugrmtizXGlQGMLp3F4sB2Jcv6rS/AulQqLrBsVKP1Vz2QE8fMixPZOiR2JVAZxTbYSOBQ==',key_name='tempest-keypair-1884580120',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-bpq36dg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-731970169',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:08:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7914d369aa429394c647f73846fe5a',uuid=57b07ad4-2f8b-4204-a885-d0bb18f02329,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "address": "fa:16:3e:b4:20:eb", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7896db0-ec", "ovs_interfaceid": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "address": "fa:16:3e:b4:20:eb", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7896db0-ec", "ovs_interfaceid": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:20:eb,bridge_name='br-int',has_traffic_filtering=True,id=f7896db0-ecb3-4b68-a4a1-846d12f21b83,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7896db0-ec') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG os_vif [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:20:eb,bridge_name='br-int',has_traffic_filtering=True,id=f7896db0-ecb3-4b68-a4a1-846d12f21b83,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7896db0-ec') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7896db0-ec, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7896db0-ec, col_values=(('external_ids', {'iface-id': 'f7896db0-ecb3-4b68-a4a1-846d12f21b83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:20:eb', 'vm-uuid': '57b07ad4-2f8b-4204-a885-d0bb18f02329'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:55 user nova-compute[73068]: INFO os_vif [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:20:eb,bridge_name='br-int',has_traffic_filtering=True,id=f7896db0-ecb3-4b68-a4a1-846d12f21b83,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7896db0-ec')
Aug 26 12:08:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:08:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No VIF found with MAC fa:16:3e:b4:20:eb, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:08:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:08:57 user nova-compute[73068]: DEBUG nova.compute.manager [req-435c2546-0947-40a1-8ad4-074cba53d235 req-060cbda1-3b67-4b79-80d1-12337db1f3bf service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-435c2546-0947-40a1-8ad4-074cba53d235 req-060cbda1-3b67-4b79-80d1-12337db1f3bf service nova] Acquiring lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-435c2546-0947-40a1-8ad4-074cba53d235 req-060cbda1-3b67-4b79-80d1-12337db1f3bf service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-435c2546-0947-40a1-8ad4-074cba53d235 req-060cbda1-3b67-4b79-80d1-12337db1f3bf service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:57 user nova-compute[73068]: DEBUG nova.compute.manager [req-435c2546-0947-40a1-8ad4-074cba53d235 req-060cbda1-3b67-4b79-80d1-12337db1f3bf service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] No waiting events found dispatching network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:57 user nova-compute[73068]: WARNING nova.compute.manager [req-435c2546-0947-40a1-8ad4-074cba53d235 req-060cbda1-3b67-4b79-80d1-12337db1f3bf service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received unexpected event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 for instance with vm_state building and task_state spawning.
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051739.1068995, 57b07ad4-2f8b-4204-a885-d0bb18f02329 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:08:59 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] VM Resumed (Lifecycle Event)
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:08:59 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Instance spawned successfully.
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:08:59 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051739.1086726, 57b07ad4-2f8b-4204-a885-d0bb18f02329 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:08:59 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] VM Started (Lifecycle Event)
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:08:59 user nova-compute[73068]: INFO nova.compute.manager [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Took 4.92 seconds to spawn the instance on the hypervisor.
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:08:59 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:08:59 user nova-compute[73068]: INFO nova.compute.manager [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Took 29.07 seconds to build instance.
Aug 26 12:08:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f863a73b-e1a2-4a5f-b145-7823eccaf626 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.163s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-6e5cff66-99fc-4119-87a0-b539324d0b8b req-19526d0b-f20f-4d1f-b9bf-348c17319211 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:08:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6e5cff66-99fc-4119-87a0-b539324d0b8b req-19526d0b-f20f-4d1f-b9bf-348c17319211 service nova] Acquiring lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:08:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6e5cff66-99fc-4119-87a0-b539324d0b8b req-19526d0b-f20f-4d1f-b9bf-348c17319211 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:08:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6e5cff66-99fc-4119-87a0-b539324d0b8b req-19526d0b-f20f-4d1f-b9bf-348c17319211 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:08:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-6e5cff66-99fc-4119-87a0-b539324d0b8b req-19526d0b-f20f-4d1f-b9bf-348c17319211 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] No waiting events found dispatching network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:08:59 user nova-compute[73068]: WARNING nova.compute.manager [req-6e5cff66-99fc-4119-87a0-b539324d0b8b req-19526d0b-f20f-4d1f-b9bf-348c17319211 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received unexpected event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 for instance with vm_state active and task_state None.
Aug 26 12:09:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:09:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:09:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:09:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:09:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:09:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:09:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:09:11 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:09:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:09:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:09:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:09:11 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:09:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:09:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:09:13 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:09:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8341MB free_disk=25.240924835205078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 57b07ad4-2f8b-4204-a885-d0bb18f02329 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:09:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:09:14 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:09:14 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:09:14 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:09:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:09:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:09:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:09:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:09:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:09:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:09:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updating instance_info_cache with network_info: [{"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:09:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:09:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:09:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:09:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:09:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:09:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:09:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:09:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:09:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:09:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:09:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:50 user nova-compute[73068]: INFO nova.compute.manager [None req-bcaf81e8-3145-43f3-bdfd-e8765aa0cd91 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Unrescuing
Aug 26 12:09:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bcaf81e8-3145-43f3-bdfd-e8765aa0cd91 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:09:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bcaf81e8-3145-43f3-bdfd-e8765aa0cd91 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquired lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:09:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-bcaf81e8-3145-43f3-bdfd-e8765aa0cd91 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:09:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-bcaf81e8-3145-43f3-bdfd-e8765aa0cd91 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updating instance_info_cache with network_info: [{"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:09:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-bcaf81e8-3145-43f3-bdfd-e8765aa0cd91 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Releasing lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:09:50 user nova-compute[73068]: DEBUG nova.objects.instance [None req-bcaf81e8-3145-43f3-bdfd-e8765aa0cd91 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'flavor' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:09:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-b306c67d-4f83-4f47-ad15-c4ec2b72b528 req-7b8c0a21-0bb7-455c-9488-92074dd2455c service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:09:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b306c67d-4f83-4f47-ad15-c4ec2b72b528 req-7b8c0a21-0bb7-455c-9488-92074dd2455c service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:09:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b306c67d-4f83-4f47-ad15-c4ec2b72b528 req-7b8c0a21-0bb7-455c-9488-92074dd2455c service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:09:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b306c67d-4f83-4f47-ad15-c4ec2b72b528 req-7b8c0a21-0bb7-455c-9488-92074dd2455c service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:09:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-b306c67d-4f83-4f47-ad15-c4ec2b72b528 req-7b8c0a21-0bb7-455c-9488-92074dd2455c service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:09:51 user nova-compute[73068]: WARNING nova.compute.manager [req-b306c67d-4f83-4f47-ad15-c4ec2b72b528 req-7b8c0a21-0bb7-455c-9488-92074dd2455c service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state rescued and task_state unrescuing.
Aug 26 12:09:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:51 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Instance destroyed successfully.
Aug 26 12:09:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:09:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:09:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:09:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:09:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:09:53 user nova-compute[73068]: WARNING nova.compute.manager [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state rescued and task_state unrescuing.
Aug 26 12:09:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:09:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:09:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:09:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:09:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:09:53 user nova-compute[73068]: WARNING nova.compute.manager [req-120a0f8c-30e1-4302-a0b0-fd6e317dc821 req-8407ad79-57f6-4f91-aaab-992ecd8c1239 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state rescued and task_state unrescuing.
Aug 26 12:09:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 12:09:54 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051794.9408894, 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:09:54 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] VM Resumed (Lifecycle Event)
Aug 26 12:09:54 user nova-compute[73068]: DEBUG nova.compute.manager [None req-bcaf81e8-3145-43f3-bdfd-e8765aa0cd91 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:09:54 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:09:54 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:09:55 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 12:09:55 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051794.944418, 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:09:55 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] VM Started (Lifecycle Event)
Aug 26 12:09:55 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:09:55 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:09:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-70e446dc-2083-4ae3-a447-cc4408cfdeed req-bd2d69ee-7993-4a5d-8d57-64fe9a3d029a service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:09:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-70e446dc-2083-4ae3-a447-cc4408cfdeed req-bd2d69ee-7993-4a5d-8d57-64fe9a3d029a service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:09:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-70e446dc-2083-4ae3-a447-cc4408cfdeed req-bd2d69ee-7993-4a5d-8d57-64fe9a3d029a service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:09:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-70e446dc-2083-4ae3-a447-cc4408cfdeed req-bd2d69ee-7993-4a5d-8d57-64fe9a3d029a service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:09:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-70e446dc-2083-4ae3-a447-cc4408cfdeed req-bd2d69ee-7993-4a5d-8d57-64fe9a3d029a service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:09:55 user nova-compute[73068]: WARNING nova.compute.manager [req-70e446dc-2083-4ae3-a447-cc4408cfdeed req-bd2d69ee-7993-4a5d-8d57-64fe9a3d029a service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state active and task_state None.
Aug 26 12:09:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:09:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:11 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:10:12 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:10:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:10:12 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:10:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:10:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:10:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:10:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:10:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:10:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:10:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:10:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:10:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8325MB free_disk=25.230697631835938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 57b07ad4-2f8b-4204-a885-d0bb18f02329 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:10:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:10:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:10:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:10:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:10:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:10:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:10:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:10:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:10:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:10:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:10:17 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Updating instance_info_cache with network_info: [{"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:10:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:10:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:10:18 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:10:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-861a7f6e-9467-4c6c-b5f2-d40d56a81b72 req-965e9ff5-3470-401b-bc86-9b4619242afa service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-changed-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:10:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-861a7f6e-9467-4c6c-b5f2-d40d56a81b72 req-965e9ff5-3470-401b-bc86-9b4619242afa service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Refreshing instance network info cache due to event network-changed-f7896db0-ecb3-4b68-a4a1-846d12f21b83. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:10:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-861a7f6e-9467-4c6c-b5f2-d40d56a81b72 req-965e9ff5-3470-401b-bc86-9b4619242afa service nova] Acquiring lock "refresh_cache-57b07ad4-2f8b-4204-a885-d0bb18f02329" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:10:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-861a7f6e-9467-4c6c-b5f2-d40d56a81b72 req-965e9ff5-3470-401b-bc86-9b4619242afa service nova] Acquired lock "refresh_cache-57b07ad4-2f8b-4204-a885-d0bb18f02329" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:10:21 user nova-compute[73068]: DEBUG nova.network.neutron [req-861a7f6e-9467-4c6c-b5f2-d40d56a81b72 req-965e9ff5-3470-401b-bc86-9b4619242afa service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Refreshing network info cache for port f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG nova.network.neutron [req-861a7f6e-9467-4c6c-b5f2-d40d56a81b72 req-965e9ff5-3470-401b-bc86-9b4619242afa service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Updated VIF entry in instance network info cache for port f7896db0-ecb3-4b68-a4a1-846d12f21b83. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG nova.network.neutron [req-861a7f6e-9467-4c6c-b5f2-d40d56a81b72 req-965e9ff5-3470-401b-bc86-9b4619242afa service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Updating instance_info_cache with network_info: [{"id": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "address": "fa:16:3e:b4:20:eb", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7896db0-ec", "ovs_interfaceid": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-861a7f6e-9467-4c6c-b5f2-d40d56a81b72 req-965e9ff5-3470-401b-bc86-9b4619242afa service nova] Releasing lock "refresh_cache-57b07ad4-2f8b-4204-a885-d0bb18f02329" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "57b07ad4-2f8b-4204-a885-d0bb18f02329" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:10:22 user nova-compute[73068]: INFO nova.compute.manager [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Terminating instance
Aug 26 12:10:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-ecc9eec8-2563-4ddc-bac9-55bb4c727bd5 req-71b23486-8a1e-46c3-8529-767126b29c8a service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-vif-unplugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ecc9eec8-2563-4ddc-bac9-55bb4c727bd5 req-71b23486-8a1e-46c3-8529-767126b29c8a service nova] Acquiring lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ecc9eec8-2563-4ddc-bac9-55bb4c727bd5 req-71b23486-8a1e-46c3-8529-767126b29c8a service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ecc9eec8-2563-4ddc-bac9-55bb4c727bd5 req-71b23486-8a1e-46c3-8529-767126b29c8a service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-ecc9eec8-2563-4ddc-bac9-55bb4c727bd5 req-71b23486-8a1e-46c3-8529-767126b29c8a service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] No waiting events found dispatching network-vif-unplugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-ecc9eec8-2563-4ddc-bac9-55bb4c727bd5 req-71b23486-8a1e-46c3-8529-767126b29c8a service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-vif-unplugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:23 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Instance destroyed successfully.
Aug 26 12:10:23 user nova-compute[73068]: DEBUG nova.objects.instance [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'resources' on Instance uuid 57b07ad4-2f8b-4204-a885-d0bb18f02329 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-802822401',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-802822401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-802822401',id=46,image_ref='90a0a3b7-c2d6-421b-82c9-11e2a4947175',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVoqmMsxATw625BpGRdVapVBJiwEylH+Z7FbCAm1cUoRBfoflLE6HmHSuNyWugrmtizXGlQGMLp3F4sB2Jcv6rS/AulQqLrBsVKP1Vz2QE8fMixPZOiR2JVAZxTbYSOBQ==',key_name='tempest-keypair-1884580120',keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-bpq36dg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-731970169',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7914d369aa429394c647f73846fe5a',uuid=57b07ad4-2f8b-4204-a885-d0bb18f02329,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "address": "fa:16:3e:b4:20:eb", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7896db0-ec", "ovs_interfaceid": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "address": "fa:16:3e:b4:20:eb", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7896db0-ec", "ovs_interfaceid": "f7896db0-ecb3-4b68-a4a1-846d12f21b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:20:eb,bridge_name='br-int',has_traffic_filtering=True,id=f7896db0-ecb3-4b68-a4a1-846d12f21b83,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7896db0-ec') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_vif [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:20:eb,bridge_name='br-int',has_traffic_filtering=True,id=f7896db0-ecb3-4b68-a4a1-846d12f21b83,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7896db0-ec') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7896db0-ec, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:23 user nova-compute[73068]: INFO os_vif [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:20:eb,bridge_name='br-int',has_traffic_filtering=True,id=f7896db0-ecb3-4b68-a4a1-846d12f21b83,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7896db0-ec')
Aug 26 12:10:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfhBgNWk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:10:23 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[063bb822-ceeb-4263-a7f4-3d6abc74a849]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb4ee5f-452d-4b25-8181-1e08096c381a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:10:23 user nova-compute[73068]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 (non-flash)
Aug 26 12:10:23 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:10:23 user nova-compute[73068]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 (non-flash)
Aug 26 12:10:23 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddbf8341f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c54e3f-ed63-4b99-a0c8-156de8a1773e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65c4833-45a0-4463-a900-80d140b2c7d7]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce70bcd-7733-4068-94b7-73698aa5df89]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b017c399-6e34-4c89-ae6b-4021533e3d6b]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[976bd812-3cea-46e4-a023-f083008f6546]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c34002-dc75-4364-a035-f147e632fe13]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47, portal: 172.16.0.220,3260]
Aug 26 12:10:23 user nova-compute[73068]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47, portal: 172.16.0.220,3260] successful.
Aug 26 12:10:23 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82059710-a7c3-4db6-86f4-58b88e6dac47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf85f3a-16c4-42fe-86a1-f6e13cac2913]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== disconnect_volume: return (306ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:10:23 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Deleting instance files /opt/stack/data/nova/instances/57b07ad4-2f8b-4204-a885-d0bb18f02329_del
Aug 26 12:10:23 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Deletion of /opt/stack/data/nova/instances/57b07ad4-2f8b-4204-a885-d0bb18f02329_del complete
Aug 26 12:10:23 user nova-compute[73068]: INFO nova.compute.manager [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 26 12:10:23 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:10:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-873c5b23-b939-4b45-856b-c7d52c554ecb req-33bb2317-c340-4657-baf8-8ce1887ea091 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-vif-deleted-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:10:24 user nova-compute[73068]: INFO nova.compute.manager [req-873c5b23-b939-4b45-856b-c7d52c554ecb req-33bb2317-c340-4657-baf8-8ce1887ea091 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Neutron deleted interface f7896db0-ecb3-4b68-a4a1-846d12f21b83; detaching it from the instance and deleting it from the info cache
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.network.neutron [req-873c5b23-b939-4b45-856b-c7d52c554ecb req-33bb2317-c340-4657-baf8-8ce1887ea091 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:10:24 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Took 0.83 seconds to deallocate network for instance.
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-873c5b23-b939-4b45-856b-c7d52c554ecb req-33bb2317-c340-4657-baf8-8ce1887ea091 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Detach interface failed, port_id=f7896db0-ecb3-4b68-a4a1-846d12f21b83, reason: Instance 57b07ad4-2f8b-4204-a885-d0bb18f02329 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Acquiring lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] No waiting events found dispatching network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:10:24 user nova-compute[73068]: WARNING nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received unexpected event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 for instance with vm_state active and task_state deleting.
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Acquiring lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] No waiting events found dispatching network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:10:24 user nova-compute[73068]: WARNING nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received unexpected event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 for instance with vm_state active and task_state deleting.
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Acquiring lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] No waiting events found dispatching network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:10:24 user nova-compute[73068]: WARNING nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received unexpected event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 for instance with vm_state active and task_state deleting.
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-vif-unplugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Acquiring lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] No waiting events found dispatching network-vif-unplugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-vif-unplugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Acquiring lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:10:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] No waiting events found dispatching network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:10:24 user nova-compute[73068]: WARNING nova.compute.manager [req-f15e0249-90aa-4c9e-9d41-20271f38b8b3 req-13146983-9688-4a12-95be-eb199dcedbc7 service nova] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Received unexpected event network-vif-plugged-f7896db0-ecb3-4b68-a4a1-846d12f21b83 for instance with vm_state active and task_state deleting.
Aug 26 12:10:25 user nova-compute[73068]: INFO nova.compute.manager [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Took 0.84 seconds to detach 1 volumes for instance.
Aug 26 12:10:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Deleting volume: 82059710-a7c3-4db6-86f4-58b88e6dac47 {{(pid=73068) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 12:10:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:10:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:10:25 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:10:25 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:10:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:10:25 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Deleted allocations for instance 57b07ad4-2f8b-4204-a885-d0bb18f02329
Aug 26 12:10:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-74ac7752-79c9-440f-a4cc-c78f9a0d714e tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "57b07ad4-2f8b-4204-a885-d0bb18f02329" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.477s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:10:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:38 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051823.2745543, 57b07ad4-2f8b-4204-a885-d0bb18f02329 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:10:38 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] VM Stopped (Lifecycle Event)
Aug 26 12:10:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-4c224b4a-8548-42c6-bc14-3260da582d6e None None] [instance: 57b07ad4-2f8b-4204-a885-d0bb18f02329] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:10:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:10:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:10:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:10:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:10:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:10:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:10:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:10:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:10:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:10:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:10:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:11:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:11:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:11:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:11:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:11:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:11:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:12 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:11:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:11:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:11:14 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:11:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8531MB free_disk=25.22812271118164GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:11:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:11:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:11:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:11:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:11:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:11:14 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:11:14 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:11:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:11:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:11:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:11:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:11:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:11:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:11:16 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:11:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:11:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:11:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:11:16 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:11:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updating instance_info_cache with network_info: [{"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:11:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:11:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:11:17 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:11:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:19 user nova-compute[73068]: INFO nova.compute.manager [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Terminating instance
Aug 26 12:11:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-9eb87f9a-f45c-43c2-91c2-d0f016015c00 req-aa6af113-ab96-4d71-bbe8-2c41dda0f51a service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Received event network-vif-unplugged-d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9eb87f9a-f45c-43c2-91c2-d0f016015c00 req-aa6af113-ab96-4d71-bbe8-2c41dda0f51a service nova] Acquiring lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9eb87f9a-f45c-43c2-91c2-d0f016015c00 req-aa6af113-ab96-4d71-bbe8-2c41dda0f51a service nova] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9eb87f9a-f45c-43c2-91c2-d0f016015c00 req-aa6af113-ab96-4d71-bbe8-2c41dda0f51a service nova] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-9eb87f9a-f45c-43c2-91c2-d0f016015c00 req-aa6af113-ab96-4d71-bbe8-2c41dda0f51a service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] No waiting events found dispatching network-vif-unplugged-d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG nova.compute.manager [req-9eb87f9a-f45c-43c2-91c2-d0f016015c00 req-aa6af113-ab96-4d71-bbe8-2c41dda0f51a service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Received event network-vif-unplugged-d4f80623-0b79-4f2a-9ae1-577141459f97 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:11:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Instance destroyed successfully.
Aug 26 12:11:19 user nova-compute[73068]: DEBUG nova.objects.instance [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'resources' on Instance uuid 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1188475010',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1188475010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1188475010',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdSvtv5LXnhTuXLJRIetq8ApdO8suqDJH3EjtkbkeVfjk5BI5fS0NV/K+9Y1fYFI/azM7NpQGLVx0DB4QDXYv+/3DcSkThvpGJhUAVybEgwuj+CaI37iArAfjSHo8I7Kg==',key_name='tempest-keypair-550479659',keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:06:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-tl7pcyk0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1c7914d369aa429394c647f73846fe5a',uuid=3d1a9d9e-10d7-495d-8cdf-d2470ca185ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "d4f80623-0b79-4f2a-9ae1-577141459f97", "address": "fa:16:3e:03:9b:d9", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f80623-0b", "ovs_interfaceid": "d4f80623-0b79-4f2a-9ae1-577141459f97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:9b:d9,bridge_name='br-int',has_traffic_filtering=True,id=d4f80623-0b79-4f2a-9ae1-577141459f97,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f80623-0b') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG os_vif [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:9b:d9,bridge_name='br-int',has_traffic_filtering=True,id=d4f80623-0b79-4f2a-9ae1-577141459f97,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f80623-0b') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4f80623-0b, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:11:20 user nova-compute[73068]: INFO os_vif [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:9b:d9,bridge_name='br-int',has_traffic_filtering=True,id=d4f80623-0b79-4f2a-9ae1-577141459f97,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f80623-0b')
Aug 26 12:11:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npKiyNow', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:11:20 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff50cf6-4012-42b6-94b9-dc3e01bb05af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a9c7ce-aa91-4640-a4d7-cc8a0143c3df]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:11:20 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 (non-flash)
Aug 26 12:11:20 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9039b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[28df0776-2453-4aef-9b8a-fd37c5bc6141]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5208fc56-8eb6-421c-b9ba-ecc6ddcaee88]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f86313-9194-427f-a737-e6145bfab79e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c126f480-cf80-4549-9271-8ec1214a63a8]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23362373735646563', '/dev/disk/by-id/scsi-1SCST_BIO941b6c06-3b775dec605a7015', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_941b6c06') {{(pid=83861) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b232e11-3e6c-40c9-abac-85dd025b01c2]: (4, None) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caada4c-bcc3-4abf-9e4a-3a88ffd665d0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2327382-5f4f-4ace-9ac2-34c9fc07dc5e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69, portal: 172.16.0.220,3260]
Aug 26 12:11:20 user nova-compute[73068]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69, portal: 172.16.0.220,3260] successful.
Aug 26 12:11:20 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2830e16-7de3-4f65-b6df-95a825b95c69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[571d0acc-8f6e-4125-bc58-30c16d3aeec1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== disconnect_volume: return (291ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:11:20 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Deleting instance files /opt/stack/data/nova/instances/3d1a9d9e-10d7-495d-8cdf-d2470ca185ee_del
Aug 26 12:11:20 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Deletion of /opt/stack/data/nova/instances/3d1a9d9e-10d7-495d-8cdf-d2470ca185ee_del complete
Aug 26 12:11:20 user nova-compute[73068]: INFO nova.compute.manager [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 26 12:11:20 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:11:20 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:11:21 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:11:21 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Took 0.90 seconds to deallocate network for instance.
Aug 26 12:11:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-a0e3ab21-2ca1-4e6a-9be4-014477e09fa3 req-34a8eb3e-c50c-4d18-a691-12c73360f8ef service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Received event network-vif-deleted-d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:11:21 user nova-compute[73068]: INFO nova.compute.manager [req-a0e3ab21-2ca1-4e6a-9be4-014477e09fa3 req-34a8eb3e-c50c-4d18-a691-12c73360f8ef service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Neutron deleted interface d4f80623-0b79-4f2a-9ae1-577141459f97; detaching it from the instance and deleting it from the info cache
Aug 26 12:11:21 user nova-compute[73068]: DEBUG nova.network.neutron [req-a0e3ab21-2ca1-4e6a-9be4-014477e09fa3 req-34a8eb3e-c50c-4d18-a691-12c73360f8ef service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:11:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-a0e3ab21-2ca1-4e6a-9be4-014477e09fa3 req-34a8eb3e-c50c-4d18-a691-12c73360f8ef service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Detach interface failed, port_id=d4f80623-0b79-4f2a-9ae1-577141459f97, reason: Instance 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 12:11:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-cce151ac-17be-441b-b57e-4c97a20d794a req-11898aad-f8c7-4069-93d8-e8989047ed69 service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Received event network-vif-plugged-d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:11:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cce151ac-17be-441b-b57e-4c97a20d794a req-11898aad-f8c7-4069-93d8-e8989047ed69 service nova] Acquiring lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cce151ac-17be-441b-b57e-4c97a20d794a req-11898aad-f8c7-4069-93d8-e8989047ed69 service nova] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-cce151ac-17be-441b-b57e-4c97a20d794a req-11898aad-f8c7-4069-93d8-e8989047ed69 service nova] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:21 user nova-compute[73068]: DEBUG nova.compute.manager [req-cce151ac-17be-441b-b57e-4c97a20d794a req-11898aad-f8c7-4069-93d8-e8989047ed69 service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] No waiting events found dispatching network-vif-plugged-d4f80623-0b79-4f2a-9ae1-577141459f97 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:11:21 user nova-compute[73068]: WARNING nova.compute.manager [req-cce151ac-17be-441b-b57e-4c97a20d794a req-11898aad-f8c7-4069-93d8-e8989047ed69 service nova] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Received unexpected event network-vif-plugged-d4f80623-0b79-4f2a-9ae1-577141459f97 for instance with vm_state active and task_state deleting.
Aug 26 12:11:22 user nova-compute[73068]: INFO nova.compute.manager [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Took 0.85 seconds to detach 1 volumes for instance.
Aug 26 12:11:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Deleting volume: f2830e16-7de3-4f65-b6df-95a825b95c69 {{(pid=73068) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 12:11:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:22 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:11:22 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:11:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:22 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Deleted allocations for instance 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee
Aug 26 12:11:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7deffca6-e6cf-4d5f-a262-3901dd4eb60f tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "3d1a9d9e-10d7-495d-8cdf-d2470ca185ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.401s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:34 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693051879.9613454, 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:11:34 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] VM Stopped (Lifecycle Event)
Aug 26 12:11:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-cd724617-5a64-4ee6-b521-89e0b943d793 None None] [instance: 3d1a9d9e-10d7-495d-8cdf-d2470ca185ee] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:11:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:11:35 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:11:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:11:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:47 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:11:47 user nova-compute[73068]: INFO nova.compute.claims [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Claim successful on node user
Aug 26 12:11:47 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:11:47 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:11:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:11:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:11:47 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:11:47 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:11:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG nova.policy [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39a8587c93764774ac04c74f11ed6498', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89262659b6e249969ee0edb7cd482d1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:11:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Creating image(s)
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk 1073741824" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.384s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Successfully created port: 06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 12:11:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Cannot resize image /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Ensure instance console log exists: /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Successfully updated port: 06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquired lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG nova.compute.manager [req-b475e593-745f-48f0-b52a-6de60fe4f62e req-51094e9d-d8a5-4c2d-af90-185406dc6de3 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-changed-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG nova.compute.manager [req-b475e593-745f-48f0-b52a-6de60fe4f62e req-51094e9d-d8a5-4c2d-af90-185406dc6de3 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Refreshing instance network info cache due to event network-changed-06493bcb-982f-4924-8f2c-48e783f0146f. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b475e593-745f-48f0-b52a-6de60fe4f62e req-51094e9d-d8a5-4c2d-af90-185406dc6de3 service nova] Acquiring lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:11:49 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updating instance_info_cache with network_info: [{"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Releasing lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Instance network_info: |[{"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b475e593-745f-48f0-b52a-6de60fe4f62e req-51094e9d-d8a5-4c2d-af90-185406dc6de3 service nova] Acquired lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.network.neutron [req-b475e593-745f-48f0-b52a-6de60fe4f62e req-51094e9d-d8a5-4c2d-af90-185406dc6de3 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Refreshing network info cache for port 06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Start _get_guest_xml network_info=[{"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:11:50 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:11:50 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-997970284',display_name='tempest-ServerRescueNegativeTestJSON-server-997970284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-997970284',id=47,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGNqrNjpKjB5tf/MlJjtAHzXEy3U5o0Xywa50RXl1WH2sf5SInDvXxv+4Ym2jmPD29nsAyrrE5wNRhrS4lYSUD1dSTnf391k48oCtunQh9h5w7tmX9iIJZI2ySEZfgYBA==',key_name='tempest-keypair-1253249556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-j31t0pyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39a8587c93764774ac04c74f11ed6498',uuid=5e0ca353-b75e-4151-ade0-d584bc4f3a95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:19:20,bridge_name='br-int',has_traffic_filtering=True,id=06493bcb-982f-4924-8f2c-48e783f0146f,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06493bcb-98') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:11:50 user nova-compute[73068]:   <uuid>5e0ca353-b75e-4151-ade0-d584bc4f3a95</uuid>
Aug 26 12:11:50 user nova-compute[73068]:   <name>instance-0000002f</name>
Aug 26 12:11:50 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:11:50 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:11:50 user nova-compute[73068]:   <metadata>
Aug 26 12:11:50 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:11:50 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:11:50 user nova-compute[73068]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-997970284</nova:name>
Aug 26 12:11:50 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:11:50</nova:creationTime>
Aug 26 12:11:50 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:11:50 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:11:50 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:11:50 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:11:50 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:11:50 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:11:50 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:11:50 user nova-compute[73068]:       <nova:owner>
Aug 26 12:11:50 user nova-compute[73068]:         <nova:user uuid="39a8587c93764774ac04c74f11ed6498">tempest-ServerRescueNegativeTestJSON-982037839-project-member</nova:user>
Aug 26 12:11:50 user nova-compute[73068]:         <nova:project uuid="89262659b6e249969ee0edb7cd482d1f">tempest-ServerRescueNegativeTestJSON-982037839</nova:project>
Aug 26 12:11:50 user nova-compute[73068]:       </nova:owner>
Aug 26 12:11:50 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 12:11:50 user nova-compute[73068]:       <nova:ports>
Aug 26 12:11:50 user nova-compute[73068]:         <nova:port uuid="06493bcb-982f-4924-8f2c-48e783f0146f">
Aug 26 12:11:50 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 12:11:50 user nova-compute[73068]:         </nova:port>
Aug 26 12:11:50 user nova-compute[73068]:       </nova:ports>
Aug 26 12:11:50 user nova-compute[73068]:     </nova:instance>
Aug 26 12:11:50 user nova-compute[73068]:   </metadata>
Aug 26 12:11:50 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:11:50 user nova-compute[73068]:     <system>
Aug 26 12:11:50 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:11:50 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:11:50 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:11:50 user nova-compute[73068]:       <entry name="serial">5e0ca353-b75e-4151-ade0-d584bc4f3a95</entry>
Aug 26 12:11:50 user nova-compute[73068]:       <entry name="uuid">5e0ca353-b75e-4151-ade0-d584bc4f3a95</entry>
Aug 26 12:11:50 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:11:50 user nova-compute[73068]:     </system>
Aug 26 12:11:50 user nova-compute[73068]:   </sysinfo>
Aug 26 12:11:50 user nova-compute[73068]:   <os>
Aug 26 12:11:50 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:11:50 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:11:50 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:11:50 user nova-compute[73068]:   </os>
Aug 26 12:11:50 user nova-compute[73068]:   <features>
Aug 26 12:11:50 user nova-compute[73068]:     <acpi/>
Aug 26 12:11:50 user nova-compute[73068]:     <apic/>
Aug 26 12:11:50 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:11:50 user nova-compute[73068]:   </features>
Aug 26 12:11:50 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:11:50 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:11:50 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:11:50 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:11:50 user nova-compute[73068]:   </clock>
Aug 26 12:11:50 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:11:50 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:11:50 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:11:50 user nova-compute[73068]:   </cpu>
Aug 26 12:11:50 user nova-compute[73068]:   <devices>
Aug 26 12:11:50 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:11:50 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:11:50 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk"/>
Aug 26 12:11:50 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:11:50 user nova-compute[73068]:     </disk>
Aug 26 12:11:50 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:11:50 user nova-compute[73068]:       <mac address="fa:16:3e:ae:19:20"/>
Aug 26 12:11:50 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:11:50 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:11:50 user nova-compute[73068]:       <target dev="tap06493bcb-98"/>
Aug 26 12:11:50 user nova-compute[73068]:     </interface>
Aug 26 12:11:50 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:11:50 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/console.log" append="off"/>
Aug 26 12:11:50 user nova-compute[73068]:     </serial>
Aug 26 12:11:50 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:11:50 user nova-compute[73068]:     <video>
Aug 26 12:11:50 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:11:50 user nova-compute[73068]:     </video>
Aug 26 12:11:50 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:11:50 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:11:50 user nova-compute[73068]:     </rng>
Aug 26 12:11:50 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:11:50 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:11:50 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:11:50 user nova-compute[73068]:     </memballoon>
Aug 26 12:11:50 user nova-compute[73068]:   </devices>
Aug 26 12:11:50 user nova-compute[73068]: </domain>
Aug 26 12:11:50 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-997970284',display_name='tempest-ServerRescueNegativeTestJSON-server-997970284',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-997970284',id=47,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGNqrNjpKjB5tf/MlJjtAHzXEy3U5o0Xywa50RXl1WH2sf5SInDvXxv+4Ym2jmPD29nsAyrrE5wNRhrS4lYSUD1dSTnf391k48oCtunQh9h5w7tmX9iIJZI2ySEZfgYBA==',key_name='tempest-keypair-1253249556',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-j31t0pyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:11:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39a8587c93764774ac04c74f11ed6498',uuid=5e0ca353-b75e-4151-ade0-d584bc4f3a95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:19:20,bridge_name='br-int',has_traffic_filtering=True,id=06493bcb-982f-4924-8f2c-48e783f0146f,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06493bcb-98') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG os_vif [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:19:20,bridge_name='br-int',has_traffic_filtering=True,id=06493bcb-982f-4924-8f2c-48e783f0146f,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06493bcb-98') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06493bcb-98, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06493bcb-98, col_values=(('external_ids', {'iface-id': '06493bcb-982f-4924-8f2c-48e783f0146f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:19:20', 'vm-uuid': '5e0ca353-b75e-4151-ade0-d584bc4f3a95'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:50 user nova-compute[73068]: INFO os_vif [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:19:20,bridge_name='br-int',has_traffic_filtering=True,id=06493bcb-982f-4924-8f2c-48e783f0146f,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06493bcb-98')
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No VIF found with MAC fa:16:3e:ae:19:20, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.network.neutron [req-b475e593-745f-48f0-b52a-6de60fe4f62e req-51094e9d-d8a5-4c2d-af90-185406dc6de3 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updated VIF entry in instance network info cache for port 06493bcb-982f-4924-8f2c-48e783f0146f. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG nova.network.neutron [req-b475e593-745f-48f0-b52a-6de60fe4f62e req-51094e9d-d8a5-4c2d-af90-185406dc6de3 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updating instance_info_cache with network_info: [{"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:11:50 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b475e593-745f-48f0-b52a-6de60fe4f62e req-51094e9d-d8a5-4c2d-af90-185406dc6de3 service nova] Releasing lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:11:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-2e96185b-53f8-49a9-b21c-992a26a9ceef req-476bb8a8-3963-49c3-9f50-165c87183f07 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:11:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2e96185b-53f8-49a9-b21c-992a26a9ceef req-476bb8a8-3963-49c3-9f50-165c87183f07 service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2e96185b-53f8-49a9-b21c-992a26a9ceef req-476bb8a8-3963-49c3-9f50-165c87183f07 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2e96185b-53f8-49a9-b21c-992a26a9ceef req-476bb8a8-3963-49c3-9f50-165c87183f07 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:51 user nova-compute[73068]: DEBUG nova.compute.manager [req-2e96185b-53f8-49a9-b21c-992a26a9ceef req-476bb8a8-3963-49c3-9f50-165c87183f07 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:11:51 user nova-compute[73068]: WARNING nova.compute.manager [req-2e96185b-53f8-49a9-b21c-992a26a9ceef req-476bb8a8-3963-49c3-9f50-165c87183f07 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received unexpected event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with vm_state building and task_state spawning.
Aug 26 12:11:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051913.6577306, 5e0ca353-b75e-4151-ade0-d584bc4f3a95 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:11:53 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] VM Resumed (Lifecycle Event)
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:11:53 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Instance spawned successfully.
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:11:53 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051913.6619456, 5e0ca353-b75e-4151-ade0-d584bc4f3a95 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:11:53 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] VM Started (Lifecycle Event)
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:11:53 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:11:53 user nova-compute[73068]: INFO nova.compute.manager [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Took 5.64 seconds to spawn the instance on the hypervisor.
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-6945808b-aedb-4992-90ba-dfc974a274f2 req-f98911d6-f90f-4435-9354-4ddf04277a8b service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6945808b-aedb-4992-90ba-dfc974a274f2 req-f98911d6-f90f-4435-9354-4ddf04277a8b service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6945808b-aedb-4992-90ba-dfc974a274f2 req-f98911d6-f90f-4435-9354-4ddf04277a8b service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6945808b-aedb-4992-90ba-dfc974a274f2 req-f98911d6-f90f-4435-9354-4ddf04277a8b service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-6945808b-aedb-4992-90ba-dfc974a274f2 req-f98911d6-f90f-4435-9354-4ddf04277a8b service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:11:53 user nova-compute[73068]: WARNING nova.compute.manager [req-6945808b-aedb-4992-90ba-dfc974a274f2 req-f98911d6-f90f-4435-9354-4ddf04277a8b service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received unexpected event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with vm_state building and task_state spawning.
Aug 26 12:11:53 user nova-compute[73068]: INFO nova.compute.manager [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Took 6.16 seconds to build instance.
Aug 26 12:11:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46276904-027b-4b1a-9505-3eaa4a39f50d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.263s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:11:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:11:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:13 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:12:13 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:12:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:12:14 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:12:14 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:12:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:12:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:12:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:12:14 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:12:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:16 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:12:16 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:12:16 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=25.19104766845703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:12:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:12:17 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:12:17 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:12:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:12:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:12:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:12:17 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:12:18 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updating instance_info_cache with network_info: [{"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:12:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:12:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:12:18 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:12:18 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:12:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:12:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "47ab6c6b-b01d-446c-9141-8942150ab31e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:12:23 user nova-compute[73068]: INFO nova.compute.claims [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Claim successful on node user
Aug 26 12:12:23 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:12:23 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:12:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:12:23 user nova-compute[73068]: INFO nova.virt.block_device [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Booting with volume 37af08cb-6dcd-4861-bcbc-01b883ce82eb at /dev/vda
Aug 26 12:12:23 user nova-compute[73068]: DEBUG os_brick.utils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:12:23 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dda1158-eda2-4b61-8d28-aaa74503b905]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0f727f-fcc2-436b-b875-16d0568ba677]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a36ba-736e-4c14-b289-1a8374d5485c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9df7278-0e03-4494-8a0d-7fb34bec4cb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:12:24 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:12:24 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d12e6a9-4262-46bb-b394-021f77d1d6ef]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG os_brick.utils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Updating existing volume attachment record: c55ba25d-e473-4631-b5d5-7dd27736cf7b {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG nova.policy [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c7914d369aa429394c647f73846fe5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681694efee294a74b277fced3266643d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:12:24 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Successfully created port: 74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:12:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:25 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Successfully updated port: 74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:12:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "refresh_cache-47ab6c6b-b01d-446c-9141-8942150ab31e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:12:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquired lock "refresh_cache-47ab6c6b-b01d-446c-9141-8942150ab31e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:12:25 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:12:25 user nova-compute[73068]: DEBUG nova.compute.manager [req-2cd13ced-3c08-46ee-8bee-2bf4b2278d0a req-0b7c6c31-ff00-48e9-9d28-44415f189edf service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Received event network-changed-74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:12:25 user nova-compute[73068]: DEBUG nova.compute.manager [req-2cd13ced-3c08-46ee-8bee-2bf4b2278d0a req-0b7c6c31-ff00-48e9-9d28-44415f189edf service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Refreshing instance network info cache due to event network-changed-74e5903f-7ef1-4081-aeaf-d9c379338f4a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:12:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2cd13ced-3c08-46ee-8bee-2bf4b2278d0a req-0b7c6c31-ff00-48e9-9d28-44415f189edf service nova] Acquiring lock "refresh_cache-47ab6c6b-b01d-446c-9141-8942150ab31e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:12:25 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:12:26 user nova-compute[73068]: DEBUG nova.network.neutron [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Updating instance_info_cache with network_info: [{"id": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "address": "fa:16:3e:c0:7d:2b", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e5903f-7e", "ovs_interfaceid": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:12:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Releasing lock "refresh_cache-47ab6c6b-b01d-446c-9141-8942150ab31e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:12:26 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Instance network_info: |[{"id": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "address": "fa:16:3e:c0:7d:2b", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e5903f-7e", "ovs_interfaceid": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:12:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2cd13ced-3c08-46ee-8bee-2bf4b2278d0a req-0b7c6c31-ff00-48e9-9d28-44415f189edf service nova] Acquired lock "refresh_cache-47ab6c6b-b01d-446c-9141-8942150ab31e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:12:26 user nova-compute[73068]: DEBUG nova.network.neutron [req-2cd13ced-3c08-46ee-8bee-2bf4b2278d0a req-0b7c6c31-ff00-48e9-9d28-44415f189edf service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Refreshing network info cache for port 74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:12:26 user nova-compute[73068]: DEBUG nova.network.neutron [req-2cd13ced-3c08-46ee-8bee-2bf4b2278d0a req-0b7c6c31-ff00-48e9-9d28-44415f189edf service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Updated VIF entry in instance network info cache for port 74e5903f-7ef1-4081-aeaf-d9c379338f4a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:12:26 user nova-compute[73068]: DEBUG nova.network.neutron [req-2cd13ced-3c08-46ee-8bee-2bf4b2278d0a req-0b7c6c31-ff00-48e9-9d28-44415f189edf service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Updating instance_info_cache with network_info: [{"id": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "address": "fa:16:3e:c0:7d:2b", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e5903f-7e", "ovs_interfaceid": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:12:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2cd13ced-3c08-46ee-8bee-2bf4b2278d0a req-0b7c6c31-ff00-48e9-9d28-44415f189edf service nova] Releasing lock "refresh_cache-47ab6c6b-b01d-446c-9141-8942150ab31e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:12:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:12:34 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Creating image(s)
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Ensure instance console log exists: /opt/stack/data/nova/instances/47ab6c6b-b01d-446c-9141-8942150ab31e/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Start _get_guest_xml network_info=[{"id": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "address": "fa:16:3e:c0:7d:2b", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e5903f-7e", "ovs_interfaceid": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'c55ba25d-e473-4631-b5d5-7dd27736cf7b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKevuPEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '47ab6c6b-b01d-446c-9141-8942150ab31e', 'attached_at': '', 'detached_at': '', 'volume_id': '37af08cb-6dcd-4861-bcbc-01b883ce82eb', 'serial': '37af08cb-6dcd-4861-bcbc-01b883ce82eb'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:12:34 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:12:34 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKevuPEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:12:34 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:12:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:12:34 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:12:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:12:34 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4910073d-371a-4f0f-af9d-019d5e64ad80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:12:34 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad156f2-2f07-4222-85f8-c3dd6e4f349d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb] added
Aug 26 12:12:34 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df2ce53-a6c0-4f62-84b8-1a01cc571340]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea91426-0aa6-4831-89ce-7e165979b1c7]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BKevuPEF {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BKevuPEF" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d370f1cf-9197-47cb-aa7f-fd01567ddf02]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BKevuPEF'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b6606-ea03-4bda-988e-873bc69b1468]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:12:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc52c45-ad65-4d30-b340-5a106fa12136]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:12:35 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:12:35 user nova-compute[73068]:  {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:12:35 user nova-compute[73068]: WARNING os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 12:12:35 user nova-compute[73068]: 
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d654a182-814e-48b0-9263-d7d1a49f833c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260]
Aug 26 12:12:35 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260] successful.
Aug 26 12:12:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eca07da-7ea1-4e5f-a2c6-6b3308f3bddc]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06e1450-4c5f-4fd3-9369-8f8e6081aa46]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:12:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:12:35 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ffdcc6-f6f3-490d-b805-dba83a2ae341]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:12:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKevuPEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23737626430616534', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737626430616534', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-114453764',display_name='tempest-TestVolumeBootPattern-server-114453764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-114453764',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGGbDW4IRPfWF2oDe7BnqRb6o5JLW4b+4VkEEmTq+OSUSPTsa+5KbFcPMJM3eoijlk/fK/7tW9d21OBnSGqw6nSrw3X4hF4egAzXJPAe2/Rr0+ZAV+DpkZLHfAspD9LzA==',key_name='tempest-TestVolumeBootPattern-888567676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-0frnbis8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:12:24Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=47ab6c6b-b01d-446c-9141-8942150ab31e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "address": "fa:16:3e:c0:7d:2b", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e5903f-7e", "ovs_interfaceid": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "address": "fa:16:3e:c0:7d:2b", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e5903f-7e", "ovs_interfaceid": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7d:2b,bridge_name='br-int',has_traffic_filtering=True,id=74e5903f-7ef1-4081-aeaf-d9c379338f4a,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e5903f-7e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG nova.objects.instance [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'pci_devices' on Instance uuid 47ab6c6b-b01d-446c-9141-8942150ab31e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:12:36 user nova-compute[73068]:   <uuid>47ab6c6b-b01d-446c-9141-8942150ab31e</uuid>
Aug 26 12:12:36 user nova-compute[73068]:   <name>instance-00000030</name>
Aug 26 12:12:36 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:12:36 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:12:36 user nova-compute[73068]:   <metadata>
Aug 26 12:12:36 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:12:36 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:12:36 user nova-compute[73068]:       <nova:name>tempest-TestVolumeBootPattern-server-114453764</nova:name>
Aug 26 12:12:36 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:12:34</nova:creationTime>
Aug 26 12:12:36 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:12:36 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:12:36 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:12:36 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:12:36 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:12:36 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:12:36 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:12:36 user nova-compute[73068]:       <nova:owner>
Aug 26 12:12:36 user nova-compute[73068]:         <nova:user uuid="1c7914d369aa429394c647f73846fe5a">tempest-TestVolumeBootPattern-731970169-project-member</nova:user>
Aug 26 12:12:36 user nova-compute[73068]:         <nova:project uuid="681694efee294a74b277fced3266643d">tempest-TestVolumeBootPattern-731970169</nova:project>
Aug 26 12:12:36 user nova-compute[73068]:       </nova:owner>
Aug 26 12:12:36 user nova-compute[73068]:       <nova:ports>
Aug 26 12:12:36 user nova-compute[73068]:         <nova:port uuid="74e5903f-7ef1-4081-aeaf-d9c379338f4a">
Aug 26 12:12:36 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 12:12:36 user nova-compute[73068]:         </nova:port>
Aug 26 12:12:36 user nova-compute[73068]:       </nova:ports>
Aug 26 12:12:36 user nova-compute[73068]:     </nova:instance>
Aug 26 12:12:36 user nova-compute[73068]:   </metadata>
Aug 26 12:12:36 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:12:36 user nova-compute[73068]:     <system>
Aug 26 12:12:36 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:12:36 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:12:36 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:12:36 user nova-compute[73068]:       <entry name="serial">47ab6c6b-b01d-446c-9141-8942150ab31e</entry>
Aug 26 12:12:36 user nova-compute[73068]:       <entry name="uuid">47ab6c6b-b01d-446c-9141-8942150ab31e</entry>
Aug 26 12:12:36 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:12:36 user nova-compute[73068]:     </system>
Aug 26 12:12:36 user nova-compute[73068]:   </sysinfo>
Aug 26 12:12:36 user nova-compute[73068]:   <os>
Aug 26 12:12:36 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:12:36 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:12:36 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:12:36 user nova-compute[73068]:   </os>
Aug 26 12:12:36 user nova-compute[73068]:   <features>
Aug 26 12:12:36 user nova-compute[73068]:     <acpi/>
Aug 26 12:12:36 user nova-compute[73068]:     <apic/>
Aug 26 12:12:36 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:12:36 user nova-compute[73068]:   </features>
Aug 26 12:12:36 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:12:36 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:12:36 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:12:36 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:12:36 user nova-compute[73068]:   </clock>
Aug 26 12:12:36 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:12:36 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:12:36 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:12:36 user nova-compute[73068]:   </cpu>
Aug 26 12:12:36 user nova-compute[73068]:   <devices>
Aug 26 12:12:36 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 12:12:36 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:12:36 user nova-compute[73068]:       <source dev="/dev/sdb"/>
Aug 26 12:12:36 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:12:36 user nova-compute[73068]:       <serial>37af08cb-6dcd-4861-bcbc-01b883ce82eb</serial>
Aug 26 12:12:36 user nova-compute[73068]:     </disk>
Aug 26 12:12:36 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:12:36 user nova-compute[73068]:       <mac address="fa:16:3e:c0:7d:2b"/>
Aug 26 12:12:36 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:12:36 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:12:36 user nova-compute[73068]:       <target dev="tap74e5903f-7e"/>
Aug 26 12:12:36 user nova-compute[73068]:     </interface>
Aug 26 12:12:36 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:12:36 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/47ab6c6b-b01d-446c-9141-8942150ab31e/console.log" append="off"/>
Aug 26 12:12:36 user nova-compute[73068]:     </serial>
Aug 26 12:12:36 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:12:36 user nova-compute[73068]:     <video>
Aug 26 12:12:36 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:12:36 user nova-compute[73068]:     </video>
Aug 26 12:12:36 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:12:36 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:12:36 user nova-compute[73068]:     </rng>
Aug 26 12:12:36 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:12:36 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:12:36 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:12:36 user nova-compute[73068]:     </memballoon>
Aug 26 12:12:36 user nova-compute[73068]:   </devices>
Aug 26 12:12:36 user nova-compute[73068]: </domain>
Aug 26 12:12:36 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-114453764',display_name='tempest-TestVolumeBootPattern-server-114453764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-114453764',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGGbDW4IRPfWF2oDe7BnqRb6o5JLW4b+4VkEEmTq+OSUSPTsa+5KbFcPMJM3eoijlk/fK/7tW9d21OBnSGqw6nSrw3X4hF4egAzXJPAe2/Rr0+ZAV+DpkZLHfAspD9LzA==',key_name='tempest-TestVolumeBootPattern-888567676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-0frnbis8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:12:24Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=47ab6c6b-b01d-446c-9141-8942150ab31e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "address": "fa:16:3e:c0:7d:2b", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e5903f-7e", "ovs_interfaceid": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "address": "fa:16:3e:c0:7d:2b", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e5903f-7e", "ovs_interfaceid": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7d:2b,bridge_name='br-int',has_traffic_filtering=True,id=74e5903f-7ef1-4081-aeaf-d9c379338f4a,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e5903f-7e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG os_vif [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7d:2b,bridge_name='br-int',has_traffic_filtering=True,id=74e5903f-7ef1-4081-aeaf-d9c379338f4a,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e5903f-7e') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74e5903f-7e, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74e5903f-7e, col_values=(('external_ids', {'iface-id': '74e5903f-7ef1-4081-aeaf-d9c379338f4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:7d:2b', 'vm-uuid': '47ab6c6b-b01d-446c-9141-8942150ab31e'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:36 user nova-compute[73068]: INFO os_vif [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7d:2b,bridge_name='br-int',has_traffic_filtering=True,id=74e5903f-7ef1-4081-aeaf-d9c379338f4a,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e5903f-7e')
Aug 26 12:12:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:12:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No VIF found with MAC fa:16:3e:c0:7d:2b, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:12:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-0fee4466-fb89-4e31-b097-8a7e26603e88 req-6d5e332e-6976-48c3-8bf7-426582351901 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Received event network-vif-plugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:12:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0fee4466-fb89-4e31-b097-8a7e26603e88 req-6d5e332e-6976-48c3-8bf7-426582351901 service nova] Acquiring lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:12:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0fee4466-fb89-4e31-b097-8a7e26603e88 req-6d5e332e-6976-48c3-8bf7-426582351901 service nova] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:12:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-0fee4466-fb89-4e31-b097-8a7e26603e88 req-6d5e332e-6976-48c3-8bf7-426582351901 service nova] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:12:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-0fee4466-fb89-4e31-b097-8a7e26603e88 req-6d5e332e-6976-48c3-8bf7-426582351901 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] No waiting events found dispatching network-vif-plugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:12:37 user nova-compute[73068]: WARNING nova.compute.manager [req-0fee4466-fb89-4e31-b097-8a7e26603e88 req-6d5e332e-6976-48c3-8bf7-426582351901 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Received unexpected event network-vif-plugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a for instance with vm_state building and task_state spawning.
Aug 26 12:12:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Verify base images {{(pid=73068) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73068) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Image id 7a04c5f4-de55-416c-8955-be802fd6bf8e yields fingerprint 494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 {{(pid=73068) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 12:12:38 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] image 7a04c5f4-de55-416c-8955-be802fd6bf8e at (/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98): checking
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] image 7a04c5f4-de55-416c-8955-be802fd6bf8e at (/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98): image is in use {{(pid=73068) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] 6dfa783d-8910-4e63-bbf5-8d803c1b26eb is a valid instance name {{(pid=73068) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] 6dfa783d-8910-4e63-bbf5-8d803c1b26eb has a disk file {{(pid=73068) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb is backed by 494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 {{(pid=73068) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] 47ab6c6b-b01d-446c-9141-8942150ab31e is a valid instance name {{(pid=73068) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] 5e0ca353-b75e-4151-ade0-d584bc4f3a95 is a valid instance name {{(pid=73068) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] 5e0ca353-b75e-4151-ade0-d584bc4f3a95 has a disk file {{(pid=73068) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 is backed by 494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 {{(pid=73068) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 is a valid instance name {{(pid=73068) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 has a disk file {{(pid=73068) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 12:12:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 is backed by 494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 {{(pid=73068) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 12:12:39 user nova-compute[73068]: WARNING nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940
Aug 26 12:12:39 user nova-compute[73068]: WARNING nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Unknown base file: /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8
Aug 26 12:12:39 user nova-compute[73068]: WARNING nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Unknown base file: /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a
Aug 26 12:12:39 user nova-compute[73068]: WARNING nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Unknown base file: /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4
Aug 26 12:12:39 user nova-compute[73068]: WARNING nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005
Aug 26 12:12:39 user nova-compute[73068]: WARNING nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50
Aug 26 12:12:39 user nova-compute[73068]: WARNING nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Unknown base file: /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2
Aug 26 12:12:39 user nova-compute[73068]: WARNING nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa
Aug 26 12:12:39 user nova-compute[73068]: WARNING nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Active base files: /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Removable base files: /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940 /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8 /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4 /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005 /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50 /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2 /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9233c870ced898382cd80028bde2bcb8206f7940
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/969d1c1291731c530569f78531d4bf6e2a0d78c8
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/91f7045af6aa359917fb7ebd5e1cffb2dd91e74a
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/55882ca54f5e6fdc42f8b173826e3c230f987db4
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b3c025982092057f13b03008714db438744d3005
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e4f95f6c0116a9577f0f542a448492c586ac1d50
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/003a7213ddc14ac5a6943424b1ba61d30a7b1df2
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b866502646b8e9d98537d1c862b4e3efb9d1d5aa
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b0050605d59af2b9df049973b6f02967bcc2e411
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Verification complete {{(pid=73068) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Verify swap images {{(pid=73068) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.imagecache [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Verify ephemeral images {{(pid=73068) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051959.6148992, 47ab6c6b-b01d-446c-9141-8942150ab31e => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] VM Resumed (Lifecycle Event)
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Instance spawned successfully.
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693051959.6225955, 47ab6c6b-b01d-446c-9141-8942150ab31e => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] VM Started (Lifecycle Event)
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.compute.manager [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-1b78f8c2-9717-4569-a09c-f62eec0c5168 req-e8ea6d2d-c746-4029-8d73-0cb034077313 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Received event network-vif-plugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1b78f8c2-9717-4569-a09c-f62eec0c5168 req-e8ea6d2d-c746-4029-8d73-0cb034077313 service nova] Acquiring lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1b78f8c2-9717-4569-a09c-f62eec0c5168 req-e8ea6d2d-c746-4029-8d73-0cb034077313 service nova] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1b78f8c2-9717-4569-a09c-f62eec0c5168 req-e8ea6d2d-c746-4029-8d73-0cb034077313 service nova] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:12:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-1b78f8c2-9717-4569-a09c-f62eec0c5168 req-e8ea6d2d-c746-4029-8d73-0cb034077313 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] No waiting events found dispatching network-vif-plugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:12:39 user nova-compute[73068]: WARNING nova.compute.manager [req-1b78f8c2-9717-4569-a09c-f62eec0c5168 req-e8ea6d2d-c746-4029-8d73-0cb034077313 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Received unexpected event network-vif-plugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a for instance with vm_state building and task_state spawning.
Aug 26 12:12:39 user nova-compute[73068]: INFO nova.compute.manager [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Took 16.38 seconds to build instance.
Aug 26 12:12:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-5b3a7c89-dfb7-4c09-b423-4528a2a0d4f8 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.490s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:12:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:12:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:12:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:12:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:12:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:12:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:12:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 6dfa783d-8910-4e63-bbf5-8d803c1b26eb {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 47ab6c6b-b01d-446c-9141-8942150ab31e {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "47ab6c6b-b01d-446c-9141-8942150ab31e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:13 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:13:14 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:14 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:15 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:13:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:17 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:13:17 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8438MB free_disk=25.18770980834961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 47ab6c6b-b01d-446c-9141-8942150ab31e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:13:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:20 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:20 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:20 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:13:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 12:13:21 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:13:21 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:25 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:13:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 12:13:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 12:13:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:13:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:13:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:13:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:13:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:13:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:37 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 12:13:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-fe198c2a-7335-4553-8188-c419f552fa6a req-9e5f3e21-728c-441f-a025-857049b0ca5f service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-changed-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:13:38 user nova-compute[73068]: DEBUG nova.compute.manager [req-fe198c2a-7335-4553-8188-c419f552fa6a req-9e5f3e21-728c-441f-a025-857049b0ca5f service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Refreshing instance network info cache due to event network-changed-06493bcb-982f-4924-8f2c-48e783f0146f. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:13:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fe198c2a-7335-4553-8188-c419f552fa6a req-9e5f3e21-728c-441f-a025-857049b0ca5f service nova] Acquiring lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:13:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fe198c2a-7335-4553-8188-c419f552fa6a req-9e5f3e21-728c-441f-a025-857049b0ca5f service nova] Acquired lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:13:38 user nova-compute[73068]: DEBUG nova.network.neutron [req-fe198c2a-7335-4553-8188-c419f552fa6a req-9e5f3e21-728c-441f-a025-857049b0ca5f service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Refreshing network info cache for port 06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG nova.objects.instance [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'flavor' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:39 user nova-compute[73068]: INFO nova.compute.manager [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Attaching volume b073d255-14bb-48be-a535-c2a85a212624 to /dev/vdb
Aug 26 12:13:39 user nova-compute[73068]: DEBUG os_brick.utils [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd86dbd-dfb9-42dc-910c-906f322f5cfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e9fb4e-e7f6-45d3-ac91-d595c0e74917]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eabe48-3481-41e5-9150-15ccac3796a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9633cac9-76a1-41ec-a8bd-e1104fa78bc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG nova.network.neutron [req-fe198c2a-7335-4553-8188-c419f552fa6a req-9e5f3e21-728c-441f-a025-857049b0ca5f service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updated VIF entry in instance network info cache for port 06493bcb-982f-4924-8f2c-48e783f0146f. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG nova.network.neutron [req-fe198c2a-7335-4553-8188-c419f552fa6a req-9e5f3e21-728c-441f-a025-857049b0ca5f service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updating instance_info_cache with network_info: [{"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fe198c2a-7335-4553-8188-c419f552fa6a req-9e5f3e21-728c-441f-a025-857049b0ca5f service nova] Releasing lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:13:39 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:13:39 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdf2ee4-1054-43e7-b71e-f7ed4ce0a4a2]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG os_brick.utils [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:13:39 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updating existing volume attachment record: 05cc202a-232e-4c0f-9731-f1f0c76054ff {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:13:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:13:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvHlAfoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:13:49 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:13:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:13:49 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:13:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:13:49 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf04eb64-fce1-499a-8797-367e2da80a60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:13:49 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c33d573-bc4b-47ee-974f-4163ff3f9df6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624] added
Aug 26 12:13:49 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0ee72a-07a6-413a-b7e7-05e78622821e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[11153a96-020f-4eb5-97dc-995a12fa634f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OvHlAfoI {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OvHlAfoI" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3063c67b-d095-4351-91e9-61a50b90af65]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OvHlAfoI'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:13:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[924fc2f9-1cc3-4952-9f6f-cc6f3b6e6d31]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8d3985-5fbf-46d1-b516-1a56660716a7]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:13:50 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:13:50 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37c4187-9be1-49ef-a09c-d06771181923]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624, portal: 172.16.0.220,3260]
Aug 26 12:13:50 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624, portal: 172.16.0.220,3260] successful.
Aug 26 12:13:50 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe93329-a4c1-4d2a-ada9-0bcfa2c54c5d]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b999f23-90b7-4d75-8f87-8211f8e7467c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:13:50 user nova-compute[73068]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:13:50 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:13:50 user nova-compute[73068]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:13:50 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f1ff9e-e17e-4c67-bafd-5c03af86e624]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:13:50 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvHlAfoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23662396434306565', 'path': '/dev/sdc'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662396434306565', 'path': '/dev/sdc'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG nova.objects.instance [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'flavor' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 12:13:51 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:13:51 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 12:13:51 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:13:51 user nova-compute[73068]:   <serial>b073d255-14bb-48be-a535-c2a85a212624</serial>
Aug 26 12:13:51 user nova-compute[73068]: </disk>
Aug 26 12:13:51 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No VIF found with MAC fa:16:3e:ae:19:20, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:13:51 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62f2c06a-79fe-46a3-82fc-41d4a3aaad49 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.366s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:52 user nova-compute[73068]: INFO nova.compute.manager [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Rescuing
Aug 26 12:13:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:13:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquired lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:13:52 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:13:52 user nova-compute[73068]: DEBUG nova.network.neutron [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updating instance_info_cache with network_info: [{"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:13:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Releasing lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-72fbfa22-1dcc-4381-8674-3c25efcd8fad req-56948391-7d0f-47cb-8101-9ead66851be1 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-unplugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-72fbfa22-1dcc-4381-8674-3c25efcd8fad req-56948391-7d0f-47cb-8101-9ead66851be1 service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-72fbfa22-1dcc-4381-8674-3c25efcd8fad req-56948391-7d0f-47cb-8101-9ead66851be1 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-72fbfa22-1dcc-4381-8674-3c25efcd8fad req-56948391-7d0f-47cb-8101-9ead66851be1 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-72fbfa22-1dcc-4381-8674-3c25efcd8fad req-56948391-7d0f-47cb-8101-9ead66851be1 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-unplugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:13:53 user nova-compute[73068]: WARNING nova.compute.manager [req-72fbfa22-1dcc-4381-8674-3c25efcd8fad req-56948391-7d0f-47cb-8101-9ead66851be1 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received unexpected event network-vif-unplugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with vm_state active and task_state rescuing.
Aug 26 12:13:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:53 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Instance destroyed successfully.
Aug 26 12:13:53 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Attempting rescue
Aug 26 12:13:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73068) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Instance directory exists: not creating {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 12:13:53 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Creating image(s)
Aug 26 12:13:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "/opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.171s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.rescue {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.rescue" returned: 0 in 0.054s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'migration_context' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.objects.base [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<5e0ca353-b75e-4151-ade0-d584bc4f3a95> lazy-loaded attributes: trusted_certs,migration_context {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Start _get_guest_xml network_info=[{"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "vif_mac": "fa:16:3e:ae:19:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'resources' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.objects.base [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<5e0ca353-b75e-4151-ade0-d584bc4f3a95> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'numa_topology' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.objects.base [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<5e0ca353-b75e-4151-ade0-d584bc4f3a95> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:13:54 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:13:54 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.objects.base [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<5e0ca353-b75e-4151-ade0-d584bc4f3a95> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-997970284',display_name='tempest-ServerRescueNegativeTestJSON-server-997970284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-997970284',id=47,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGNqrNjpKjB5tf/MlJjtAHzXEy3U5o0Xywa50RXl1WH2sf5SInDvXxv+4Ym2jmPD29nsAyrrE5wNRhrS4lYSUD1dSTnf391k48oCtunQh9h5w7tmX9iIJZI2ySEZfgYBA==',key_name='tempest-keypair-1253249556',keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:11:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-j31t0pyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39a8587c93764774ac04c74f11ed6498',uuid=5e0ca353-b75e-4151-ade0-d584bc4f3a95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "vif_mac": "fa:16:3e:ae:19:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "vif_mac": "fa:16:3e:ae:19:20"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:19:20,bridge_name='br-int',has_traffic_filtering=True,id=06493bcb-982f-4924-8f2c-48e783f0146f,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06493bcb-98') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.objects.base [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Object Instance<5e0ca353-b75e-4151-ade0-d584bc4f3a95> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=73068) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:13:54 user nova-compute[73068]:   <uuid>5e0ca353-b75e-4151-ade0-d584bc4f3a95</uuid>
Aug 26 12:13:54 user nova-compute[73068]:   <name>instance-0000002f</name>
Aug 26 12:13:54 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:13:54 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:13:54 user nova-compute[73068]:   <metadata>
Aug 26 12:13:54 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:13:54 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:13:54 user nova-compute[73068]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-997970284</nova:name>
Aug 26 12:13:54 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:13:54</nova:creationTime>
Aug 26 12:13:54 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:13:54 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:13:54 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:13:54 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:13:54 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:13:54 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:13:54 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:13:54 user nova-compute[73068]:       <nova:owner>
Aug 26 12:13:54 user nova-compute[73068]:         <nova:user uuid="39a8587c93764774ac04c74f11ed6498">tempest-ServerRescueNegativeTestJSON-982037839-project-member</nova:user>
Aug 26 12:13:54 user nova-compute[73068]:         <nova:project uuid="89262659b6e249969ee0edb7cd482d1f">tempest-ServerRescueNegativeTestJSON-982037839</nova:project>
Aug 26 12:13:54 user nova-compute[73068]:       </nova:owner>
Aug 26 12:13:54 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 12:13:54 user nova-compute[73068]:       <nova:ports>
Aug 26 12:13:54 user nova-compute[73068]:         <nova:port uuid="06493bcb-982f-4924-8f2c-48e783f0146f">
Aug 26 12:13:54 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 12:13:54 user nova-compute[73068]:         </nova:port>
Aug 26 12:13:54 user nova-compute[73068]:       </nova:ports>
Aug 26 12:13:54 user nova-compute[73068]:     </nova:instance>
Aug 26 12:13:54 user nova-compute[73068]:   </metadata>
Aug 26 12:13:54 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:13:54 user nova-compute[73068]:     <system>
Aug 26 12:13:54 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:13:54 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:13:54 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:13:54 user nova-compute[73068]:       <entry name="serial">5e0ca353-b75e-4151-ade0-d584bc4f3a95</entry>
Aug 26 12:13:54 user nova-compute[73068]:       <entry name="uuid">5e0ca353-b75e-4151-ade0-d584bc4f3a95</entry>
Aug 26 12:13:54 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:13:54 user nova-compute[73068]:     </system>
Aug 26 12:13:54 user nova-compute[73068]:   </sysinfo>
Aug 26 12:13:54 user nova-compute[73068]:   <os>
Aug 26 12:13:54 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:13:54 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:13:54 user nova-compute[73068]:   </os>
Aug 26 12:13:54 user nova-compute[73068]:   <features>
Aug 26 12:13:54 user nova-compute[73068]:     <acpi/>
Aug 26 12:13:54 user nova-compute[73068]:     <apic/>
Aug 26 12:13:54 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:13:54 user nova-compute[73068]:   </features>
Aug 26 12:13:54 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:13:54 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:13:54 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:13:54 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:13:54 user nova-compute[73068]:   </clock>
Aug 26 12:13:54 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:13:54 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:13:54 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:13:54 user nova-compute[73068]:   </cpu>
Aug 26 12:13:54 user nova-compute[73068]:   <devices>
Aug 26 12:13:54 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:13:54 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:13:54 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.rescue"/>
Aug 26 12:13:54 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:13:54 user nova-compute[73068]:     </disk>
Aug 26 12:13:54 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:13:54 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:13:54 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk"/>
Aug 26 12:13:54 user nova-compute[73068]:       <target dev="vdb" bus="virtio"/>
Aug 26 12:13:54 user nova-compute[73068]:     </disk>
Aug 26 12:13:54 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:13:54 user nova-compute[73068]:       <mac address="fa:16:3e:ae:19:20"/>
Aug 26 12:13:54 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:13:54 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:13:54 user nova-compute[73068]:       <target dev="tap06493bcb-98"/>
Aug 26 12:13:54 user nova-compute[73068]:     </interface>
Aug 26 12:13:54 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:13:54 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/console.log" append="off"/>
Aug 26 12:13:54 user nova-compute[73068]:     </serial>
Aug 26 12:13:54 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:13:54 user nova-compute[73068]:     <video>
Aug 26 12:13:54 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:13:54 user nova-compute[73068]:     </video>
Aug 26 12:13:54 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:13:54 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:13:54 user nova-compute[73068]:     </rng>
Aug 26 12:13:54 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:13:54 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:13:54 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:13:54 user nova-compute[73068]:     </memballoon>
Aug 26 12:13:54 user nova-compute[73068]:   </devices>
Aug 26 12:13:54 user nova-compute[73068]: </domain>
Aug 26 12:13:54 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:13:54 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Instance destroyed successfully.
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:13:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] No VIF found with MAC fa:16:3e:ae:19:20, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:13:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-45d9e446-6470-43a1-be0d-dc9cd5f02bd2 req-7b886b01-d531-4a03-ac2f-fa0545853192 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:13:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-45d9e446-6470-43a1-be0d-dc9cd5f02bd2 req-7b886b01-d531-4a03-ac2f-fa0545853192 service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-45d9e446-6470-43a1-be0d-dc9cd5f02bd2 req-7b886b01-d531-4a03-ac2f-fa0545853192 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-45d9e446-6470-43a1-be0d-dc9cd5f02bd2 req-7b886b01-d531-4a03-ac2f-fa0545853192 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-45d9e446-6470-43a1-be0d-dc9cd5f02bd2 req-7b886b01-d531-4a03-ac2f-fa0545853192 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:13:55 user nova-compute[73068]: WARNING nova.compute.manager [req-45d9e446-6470-43a1-be0d-dc9cd5f02bd2 req-7b886b01-d531-4a03-ac2f-fa0545853192 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received unexpected event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with vm_state active and task_state rescuing.
Aug 26 12:13:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.compute.manager [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.compute.manager [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:13:57 user nova-compute[73068]: WARNING nova.compute.manager [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received unexpected event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with vm_state active and task_state rescuing.
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.compute.manager [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.compute.manager [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:13:57 user nova-compute[73068]: WARNING nova.compute.manager [req-86b2d714-6fdf-40d0-921e-8597a5c24bcb req-59971173-f936-4c9a-8489-c54d8ce38e22 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received unexpected event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with vm_state active and task_state rescuing.
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for 5e0ca353-b75e-4151-ade0-d584bc4f3a95 due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052037.6393335, 5e0ca353-b75e-4151-ade0-d584bc4f3a95 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:13:57 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] VM Resumed (Lifecycle Event)
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a00fde0c-6bad-46f7-977b-237806d82006 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:13:57 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052037.6429164, 5e0ca353-b75e-4151-ade0-d584bc4f3a95 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:13:57 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] VM Started (Lifecycle Event)
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:13:57 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:14:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:14:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:14:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:13 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:14:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-179f2fed-6c53-4c71-9f32-b0d8c01dc7dd req-1f60d8ff-e72b-4edf-925f-2da6e9c9eae2 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Received event network-changed-74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-179f2fed-6c53-4c71-9f32-b0d8c01dc7dd req-1f60d8ff-e72b-4edf-925f-2da6e9c9eae2 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Refreshing instance network info cache due to event network-changed-74e5903f-7ef1-4081-aeaf-d9c379338f4a. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-179f2fed-6c53-4c71-9f32-b0d8c01dc7dd req-1f60d8ff-e72b-4edf-925f-2da6e9c9eae2 service nova] Acquiring lock "refresh_cache-47ab6c6b-b01d-446c-9141-8942150ab31e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-179f2fed-6c53-4c71-9f32-b0d8c01dc7dd req-1f60d8ff-e72b-4edf-925f-2da6e9c9eae2 service nova] Acquired lock "refresh_cache-47ab6c6b-b01d-446c-9141-8942150ab31e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG nova.network.neutron [req-179f2fed-6c53-4c71-9f32-b0d8c01dc7dd req-1f60d8ff-e72b-4edf-925f-2da6e9c9eae2 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Refreshing network info cache for port 74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG nova.network.neutron [req-179f2fed-6c53-4c71-9f32-b0d8c01dc7dd req-1f60d8ff-e72b-4edf-925f-2da6e9c9eae2 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Updated VIF entry in instance network info cache for port 74e5903f-7ef1-4081-aeaf-d9c379338f4a. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG nova.network.neutron [req-179f2fed-6c53-4c71-9f32-b0d8c01dc7dd req-1f60d8ff-e72b-4edf-925f-2da6e9c9eae2 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Updating instance_info_cache with network_info: [{"id": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "address": "fa:16:3e:c0:7d:2b", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e5903f-7e", "ovs_interfaceid": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-179f2fed-6c53-4c71-9f32-b0d8c01dc7dd req-1f60d8ff-e72b-4edf-925f-2da6e9c9eae2 service nova] Releasing lock "refresh_cache-47ab6c6b-b01d-446c-9141-8942150ab31e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "47ab6c6b-b01d-446c-9141-8942150ab31e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:14:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:14:15 user nova-compute[73068]: INFO nova.compute.manager [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Terminating instance
Aug 26 12:14:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-585170a0-3df8-4c61-a0f0-c0ae26a284c8 req-40f15efd-440f-49b9-91bc-b571ad45c33e service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Received event network-vif-unplugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-585170a0-3df8-4c61-a0f0-c0ae26a284c8 req-40f15efd-440f-49b9-91bc-b571ad45c33e service nova] Acquiring lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-585170a0-3df8-4c61-a0f0-c0ae26a284c8 req-40f15efd-440f-49b9-91bc-b571ad45c33e service nova] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-585170a0-3df8-4c61-a0f0-c0ae26a284c8 req-40f15efd-440f-49b9-91bc-b571ad45c33e service nova] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-585170a0-3df8-4c61-a0f0-c0ae26a284c8 req-40f15efd-440f-49b9-91bc-b571ad45c33e service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] No waiting events found dispatching network-vif-unplugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-585170a0-3df8-4c61-a0f0-c0ae26a284c8 req-40f15efd-440f-49b9-91bc-b571ad45c33e service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Received event network-vif-unplugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:14:16 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Instance destroyed successfully.
Aug 26 12:14:16 user nova-compute[73068]: DEBUG nova.objects.instance [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'resources' on Instance uuid 47ab6c6b-b01d-446c-9141-8942150ab31e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:12:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-114453764',display_name='tempest-TestVolumeBootPattern-server-114453764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-114453764',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGGbDW4IRPfWF2oDe7BnqRb6o5JLW4b+4VkEEmTq+OSUSPTsa+5KbFcPMJM3eoijlk/fK/7tW9d21OBnSGqw6nSrw3X4hF4egAzXJPAe2/Rr0+ZAV+DpkZLHfAspD9LzA==',key_name='tempest-TestVolumeBootPattern-888567676',keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:12:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-0frnbis8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:12:40Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=47ab6c6b-b01d-446c-9141-8942150ab31e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "address": "fa:16:3e:c0:7d:2b", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e5903f-7e", "ovs_interfaceid": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "address": "fa:16:3e:c0:7d:2b", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74e5903f-7e", "ovs_interfaceid": "74e5903f-7ef1-4081-aeaf-d9c379338f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7d:2b,bridge_name='br-int',has_traffic_filtering=True,id=74e5903f-7ef1-4081-aeaf-d9c379338f4a,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e5903f-7e') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_vif [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7d:2b,bridge_name='br-int',has_traffic_filtering=True,id=74e5903f-7ef1-4081-aeaf-d9c379338f4a,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e5903f-7e') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74e5903f-7e, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:14:16 user nova-compute[73068]: INFO os_vif [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:7d:2b,bridge_name='br-int',has_traffic_filtering=True,id=74e5903f-7ef1-4081-aeaf-d9c379338f4a,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74e5903f-7e')
Aug 26 12:14:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKevuPEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:14:16 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c272b6c5-e702-41e8-a961-231a346ddabc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaf4f2a-eb77-4c6d-97bf-6f074f52b107]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:14:16 user nova-compute[73068]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:14:16 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:14:16 user nova-compute[73068]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:14:16 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddbf8d39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9e3653-2af3-40bf-a680-9c97c56ba421]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f83e78-0315-4d39-8de4-8b4852db0176]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d732470d-af4f-4bef-b6a8-bae86a88e9a1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa652e30-ef7f-4c39-ba1c-c9c01b74c359]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23737626430616534', '/dev/disk/by-id/scsi-1SCST_BIOed0cf5fe-77bd0ae4ad0c5f08', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ed0cf5fe') {{(pid=83861) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[100737eb-93b2-4e87-9adb-323d2924bd06]: (4, None) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d9ba29-87ef-47eb-92b7-974f81adcc95]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:14:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a75aa0-45d2-4767-be35-fdc125bc597a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260]
Aug 26 12:14:17 user nova-compute[73068]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260] successful.
Aug 26 12:14:17 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae689a4-23af-4540-9ed7-b68672029091]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== disconnect_volume: return (343ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:14:17 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Deleting instance files /opt/stack/data/nova/instances/47ab6c6b-b01d-446c-9141-8942150ab31e_del
Aug 26 12:14:17 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Deletion of /opt/stack/data/nova/instances/47ab6c6b-b01d-446c-9141-8942150ab31e_del complete
Aug 26 12:14:17 user nova-compute[73068]: INFO nova.compute.manager [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:17 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:14:17 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Took 0.78 seconds to deallocate network for instance.
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:17 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Error from libvirt while getting description of instance-00000030: [Error Code 42] Domain not found: no domain with matching uuid '47ab6c6b-b01d-446c-9141-8942150ab31e' (instance-00000030): libvirt.libvirtError: Domain not found: no domain with matching uuid '47ab6c6b-b01d-446c-9141-8942150ab31e' (instance-00000030)
Aug 26 12:14:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-2978fba9-5167-46a8-84aa-7a41660821d9 req-7e906e6b-7a37-4279-a445-69edbfa446a7 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Received event network-vif-deleted-74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-efdc7b29-5424-4b6f-92ec-792cfd113b72 req-9f9fc87e-89fb-4470-b60c-3a61a541eea2 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Received event network-vif-plugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-efdc7b29-5424-4b6f-92ec-792cfd113b72 req-9f9fc87e-89fb-4470-b60c-3a61a541eea2 service nova] Acquiring lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-efdc7b29-5424-4b6f-92ec-792cfd113b72 req-9f9fc87e-89fb-4470-b60c-3a61a541eea2 service nova] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-efdc7b29-5424-4b6f-92ec-792cfd113b72 req-9f9fc87e-89fb-4470-b60c-3a61a541eea2 service nova] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG nova.compute.manager [req-efdc7b29-5424-4b6f-92ec-792cfd113b72 req-9f9fc87e-89fb-4470-b60c-3a61a541eea2 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] No waiting events found dispatching network-vif-plugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:14:18 user nova-compute[73068]: WARNING nova.compute.manager [req-efdc7b29-5424-4b6f-92ec-792cfd113b72 req-9f9fc87e-89fb-4470-b60c-3a61a541eea2 service nova] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Received unexpected event network-vif-plugged-74e5903f-7ef1-4081-aeaf-d9c379338f4a for instance with vm_state active and task_state deleting.
Aug 26 12:14:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:14:18 user nova-compute[73068]: INFO nova.compute.manager [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Took 0.86 seconds to detach 1 volumes for instance.
Aug 26 12:14:18 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:14:18 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:14:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8493MB free_disk=25.18560791015625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 47ab6c6b-b01d-446c-9141-8942150ab31e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:14:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:14:19 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:14:19 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:14:19 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:14:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:14:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.215s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:14:19 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:14:19 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:14:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:14:19 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Deleted allocations for instance 47ab6c6b-b01d-446c-9141-8942150ab31e
Aug 26 12:14:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-c832c436-3bac-4326-a38f-7d3d7f70dc59 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "47ab6c6b-b01d-446c-9141-8942150ab31e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.444s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:14:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updating instance_info_cache with network_info: [{"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:14:22 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:14:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:31 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693052056.705666, 47ab6c6b-b01d-446c-9141-8942150ab31e => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:14:31 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] VM Stopped (Lifecycle Event)
Aug 26 12:14:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-1d3eef88-b321-467b-8db9-acdab97ee8a4 None None] [instance: 47ab6c6b-b01d-446c-9141-8942150ab31e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:14:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:14:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:14:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:14:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:14:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:14:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:14:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:14:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:14:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:14:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:14:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:14:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:15:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "efcec8a5-ee86-4792-8fe9-5895904d87e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:15:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:15:07 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:15:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:15:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:15:07 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:15:07 user nova-compute[73068]: INFO nova.compute.claims [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Claim successful on node user
Aug 26 12:15:08 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:15:08 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:15:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:15:08 user nova-compute[73068]: INFO nova.virt.block_device [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Booting with volume 37af08cb-6dcd-4861-bcbc-01b883ce82eb at /dev/vda
Aug 26 12:15:08 user nova-compute[73068]: DEBUG nova.policy [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c7914d369aa429394c647f73846fe5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681694efee294a74b277fced3266643d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG os_brick.utils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f02497-341d-4740-8665-7afca6e03c15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[765902c0-a794-4fda-af89-fc49f2cbae4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf81327-63ef-4040-981d-2b3b9a8b6287]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd19d67-49cc-4d01-aab7-bf2509d98c17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:15:08 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:15:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2ac9a8-3c91-48e8-b17e-2bd6cedfd49a]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG os_brick.utils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:15:08 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Updating existing volume attachment record: 9c1180cf-4884-4654-95e9-19e1e3d56024 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:15:09 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Successfully created port: 8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Successfully updated port: 8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquired lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-a1aa59f3-b585-4276-9351-e2ef371505b0 req-ba807170-91e3-42d2-8b72-206bc9df2267 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-changed-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-a1aa59f3-b585-4276-9351-e2ef371505b0 req-ba807170-91e3-42d2-8b72-206bc9df2267 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Refreshing instance network info cache due to event network-changed-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a1aa59f3-b585-4276-9351-e2ef371505b0 req-ba807170-91e3-42d2-8b72-206bc9df2267 service nova] Acquiring lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG nova.network.neutron [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Updating instance_info_cache with network_info: [{"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Releasing lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Instance network_info: |[{"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a1aa59f3-b585-4276-9351-e2ef371505b0 req-ba807170-91e3-42d2-8b72-206bc9df2267 service nova] Acquired lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:15:10 user nova-compute[73068]: DEBUG nova.network.neutron [req-a1aa59f3-b585-4276-9351-e2ef371505b0 req-ba807170-91e3-42d2-8b72-206bc9df2267 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Refreshing network info cache for port 8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:15:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-a1aa59f3-b585-4276-9351-e2ef371505b0 req-ba807170-91e3-42d2-8b72-206bc9df2267 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Updated VIF entry in instance network info cache for port 8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:15:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-a1aa59f3-b585-4276-9351-e2ef371505b0 req-ba807170-91e3-42d2-8b72-206bc9df2267 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Updating instance_info_cache with network_info: [{"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:15:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-a1aa59f3-b585-4276-9351-e2ef371505b0 req-ba807170-91e3-42d2-8b72-206bc9df2267 service nova] Releasing lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:15:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:15:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:15:18 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:15:18 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:15:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=25.184432983398438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance efcec8a5-ee86-4792-8fe9-5895904d87e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:15:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:15:19 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Creating image(s)
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Ensure instance console log exists: /opt/stack/data/nova/instances/efcec8a5-ee86-4792-8fe9-5895904d87e9/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Start _get_guest_xml network_info=[{"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '9c1180cf-4884-4654-95e9-19e1e3d56024', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKevuPEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'efcec8a5-ee86-4792-8fe9-5895904d87e9', 'attached_at': '', 'detached_at': '', 'volume_id': '37af08cb-6dcd-4861-bcbc-01b883ce82eb', 'serial': '37af08cb-6dcd-4861-bcbc-01b883ce82eb'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:15:19 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:15:19 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKevuPEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:15:19 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:15:19 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:15:19 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28efc83-a035-4352-bec4-73e062b35b6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:15:19 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[019316b9-43ab-4e52-a3e8-b32b3615d0cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb] added
Aug 26 12:15:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ad9ddf-a591-4057-8f41-523e83ef9af1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2c61dc-d9e7-4d3e-b2e5-ba243c9cfac4]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BKevuPEF {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BKevuPEF" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[777e0a4e-286c-4c11-a169-a2b964078770]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BKevuPEF'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[be21d439-fc47-48c7-8761-e44bf16c095f]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72ad6c2-abe9-4ca2-95a8-3403ebee335d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:15:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:15:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafa6f21-b522-40f9-b2ba-0c529f7d9d91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260]
Aug 26 12:15:19 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260] successful.
Aug 26 12:15:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bb6021-1c11-4015-80b9-180809c53034]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f8030e-a74d-42a4-9806-f060d2889852]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:15:19 user nova-compute[73068]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:15:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:15:19 user nova-compute[73068]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:15:19 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e9a5b2-6b36-4538-bafd-74ee68663639]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:15:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKevuPEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23737626430616534', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737626430616534', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-520306355',display_name='tempest-TestVolumeBootPattern-server-520306355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-520306355',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGGbDW4IRPfWF2oDe7BnqRb6o5JLW4b+4VkEEmTq+OSUSPTsa+5KbFcPMJM3eoijlk/fK/7tW9d21OBnSGqw6nSrw3X4hF4egAzXJPAe2/Rr0+ZAV+DpkZLHfAspD9LzA==',key_name='tempest-TestVolumeBootPattern-888567676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-7me80dbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:15:08Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=efcec8a5-ee86-4792-8fe9-5895904d87e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a846e4f-70') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG nova.objects.instance [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'pci_devices' on Instance uuid efcec8a5-ee86-4792-8fe9-5895904d87e9 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:15:20 user nova-compute[73068]:   <uuid>efcec8a5-ee86-4792-8fe9-5895904d87e9</uuid>
Aug 26 12:15:20 user nova-compute[73068]:   <name>instance-00000031</name>
Aug 26 12:15:20 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:15:20 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:15:20 user nova-compute[73068]:   <metadata>
Aug 26 12:15:20 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:15:20 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:15:20 user nova-compute[73068]:       <nova:name>tempest-TestVolumeBootPattern-server-520306355</nova:name>
Aug 26 12:15:20 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:15:19</nova:creationTime>
Aug 26 12:15:20 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:15:20 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:15:20 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:15:20 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:15:20 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:15:20 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:15:20 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:15:20 user nova-compute[73068]:       <nova:owner>
Aug 26 12:15:20 user nova-compute[73068]:         <nova:user uuid="1c7914d369aa429394c647f73846fe5a">tempest-TestVolumeBootPattern-731970169-project-member</nova:user>
Aug 26 12:15:20 user nova-compute[73068]:         <nova:project uuid="681694efee294a74b277fced3266643d">tempest-TestVolumeBootPattern-731970169</nova:project>
Aug 26 12:15:20 user nova-compute[73068]:       </nova:owner>
Aug 26 12:15:20 user nova-compute[73068]:       <nova:ports>
Aug 26 12:15:20 user nova-compute[73068]:         <nova:port uuid="8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc">
Aug 26 12:15:20 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 12:15:20 user nova-compute[73068]:         </nova:port>
Aug 26 12:15:20 user nova-compute[73068]:       </nova:ports>
Aug 26 12:15:20 user nova-compute[73068]:     </nova:instance>
Aug 26 12:15:20 user nova-compute[73068]:   </metadata>
Aug 26 12:15:20 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:15:20 user nova-compute[73068]:     <system>
Aug 26 12:15:20 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:15:20 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:15:20 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:15:20 user nova-compute[73068]:       <entry name="serial">efcec8a5-ee86-4792-8fe9-5895904d87e9</entry>
Aug 26 12:15:20 user nova-compute[73068]:       <entry name="uuid">efcec8a5-ee86-4792-8fe9-5895904d87e9</entry>
Aug 26 12:15:20 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:15:20 user nova-compute[73068]:     </system>
Aug 26 12:15:20 user nova-compute[73068]:   </sysinfo>
Aug 26 12:15:20 user nova-compute[73068]:   <os>
Aug 26 12:15:20 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:15:20 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:15:20 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:15:20 user nova-compute[73068]:   </os>
Aug 26 12:15:20 user nova-compute[73068]:   <features>
Aug 26 12:15:20 user nova-compute[73068]:     <acpi/>
Aug 26 12:15:20 user nova-compute[73068]:     <apic/>
Aug 26 12:15:20 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:15:20 user nova-compute[73068]:   </features>
Aug 26 12:15:20 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:15:20 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:15:20 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:15:20 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:15:20 user nova-compute[73068]:   </clock>
Aug 26 12:15:20 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:15:20 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:15:20 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:15:20 user nova-compute[73068]:   </cpu>
Aug 26 12:15:20 user nova-compute[73068]:   <devices>
Aug 26 12:15:20 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 12:15:20 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:15:20 user nova-compute[73068]:       <source dev="/dev/sdb"/>
Aug 26 12:15:20 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:15:20 user nova-compute[73068]:       <serial>37af08cb-6dcd-4861-bcbc-01b883ce82eb</serial>
Aug 26 12:15:20 user nova-compute[73068]:     </disk>
Aug 26 12:15:20 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:15:20 user nova-compute[73068]:       <mac address="fa:16:3e:ac:ca:e4"/>
Aug 26 12:15:20 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:15:20 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:15:20 user nova-compute[73068]:       <target dev="tap8a846e4f-70"/>
Aug 26 12:15:20 user nova-compute[73068]:     </interface>
Aug 26 12:15:20 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:15:20 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/efcec8a5-ee86-4792-8fe9-5895904d87e9/console.log" append="off"/>
Aug 26 12:15:20 user nova-compute[73068]:     </serial>
Aug 26 12:15:20 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:15:20 user nova-compute[73068]:     <video>
Aug 26 12:15:20 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:15:20 user nova-compute[73068]:     </video>
Aug 26 12:15:20 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:15:20 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:15:20 user nova-compute[73068]:     </rng>
Aug 26 12:15:20 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:15:20 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:15:20 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:15:20 user nova-compute[73068]:     </memballoon>
Aug 26 12:15:20 user nova-compute[73068]:   </devices>
Aug 26 12:15:20 user nova-compute[73068]: </domain>
Aug 26 12:15:20 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-520306355',display_name='tempest-TestVolumeBootPattern-server-520306355',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-520306355',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGGbDW4IRPfWF2oDe7BnqRb6o5JLW4b+4VkEEmTq+OSUSPTsa+5KbFcPMJM3eoijlk/fK/7tW9d21OBnSGqw6nSrw3X4hF4egAzXJPAe2/Rr0+ZAV+DpkZLHfAspD9LzA==',key_name='tempest-TestVolumeBootPattern-888567676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-7me80dbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:15:08Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=efcec8a5-ee86-4792-8fe9-5895904d87e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a846e4f-70') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG os_vif [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a846e4f-70') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a846e4f-70, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a846e4f-70, col_values=(('external_ids', {'iface-id': '8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:ca:e4', 'vm-uuid': 'efcec8a5-ee86-4792-8fe9-5895904d87e9'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:20 user nova-compute[73068]: INFO os_vif [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a846e4f-70')
Aug 26 12:15:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:15:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No VIF found with MAC fa:16:3e:ac:ca:e4, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:15:21 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:15:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:15:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:15:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:15:21 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:15:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-d52544d8-bcac-436f-8d59-13cd7a030bc9 req-c6564ad3-e353-49eb-a23a-320129fa9410 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d52544d8-bcac-436f-8d59-13cd7a030bc9 req-c6564ad3-e353-49eb-a23a-320129fa9410 service nova] Acquiring lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d52544d8-bcac-436f-8d59-13cd7a030bc9 req-c6564ad3-e353-49eb-a23a-320129fa9410 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d52544d8-bcac-436f-8d59-13cd7a030bc9 req-c6564ad3-e353-49eb-a23a-320129fa9410 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-d52544d8-bcac-436f-8d59-13cd7a030bc9 req-c6564ad3-e353-49eb-a23a-320129fa9410 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] No waiting events found dispatching network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:15:22 user nova-compute[73068]: WARNING nova.compute.manager [req-d52544d8-bcac-436f-8d59-13cd7a030bc9 req-c6564ad3-e353-49eb-a23a-320129fa9410 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received unexpected event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc for instance with vm_state building and task_state spawning.
Aug 26 12:15:22 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updating instance_info_cache with network_info: [{"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052123.812096, efcec8a5-ee86-4792-8fe9-5895904d87e9 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:15:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] VM Resumed (Lifecycle Event)
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:15:23 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Instance spawned successfully.
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:15:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052123.8131266, efcec8a5-ee86-4792-8fe9-5895904d87e9 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:15:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] VM Started (Lifecycle Event)
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:15:23 user nova-compute[73068]: INFO nova.compute.manager [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 26 12:15:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:15:23 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:15:23 user nova-compute[73068]: INFO nova.compute.manager [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Took 16.20 seconds to build instance.
Aug 26 12:15:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f9c65803-01b5-4d62-8eb0-a9dc08a4496d tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.302s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:15:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-9be6939c-a3d7-4631-847d-0bda85fbd806 req-ffa4c5d7-a48b-4747-9f6d-ed86a539bccc service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:15:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9be6939c-a3d7-4631-847d-0bda85fbd806 req-ffa4c5d7-a48b-4747-9f6d-ed86a539bccc service nova] Acquiring lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:15:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9be6939c-a3d7-4631-847d-0bda85fbd806 req-ffa4c5d7-a48b-4747-9f6d-ed86a539bccc service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:15:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9be6939c-a3d7-4631-847d-0bda85fbd806 req-ffa4c5d7-a48b-4747-9f6d-ed86a539bccc service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:15:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-9be6939c-a3d7-4631-847d-0bda85fbd806 req-ffa4c5d7-a48b-4747-9f6d-ed86a539bccc service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] No waiting events found dispatching network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:15:24 user nova-compute[73068]: WARNING nova.compute.manager [req-9be6939c-a3d7-4631-847d-0bda85fbd806 req-ffa4c5d7-a48b-4747-9f6d-ed86a539bccc service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received unexpected event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc for instance with vm_state active and task_state None.
Aug 26 12:15:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:43 user nova-compute[73068]: INFO nova.compute.manager [None req-8488d8d0-cbce-4ef0-9ca5-d294e14adc89 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Unrescuing
Aug 26 12:15:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8488d8d0-cbce-4ef0-9ca5-d294e14adc89 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:15:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8488d8d0-cbce-4ef0-9ca5-d294e14adc89 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquired lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:15:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-8488d8d0-cbce-4ef0-9ca5-d294e14adc89 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:15:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-8488d8d0-cbce-4ef0-9ca5-d294e14adc89 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updating instance_info_cache with network_info: [{"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:15:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-8488d8d0-cbce-4ef0-9ca5-d294e14adc89 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Releasing lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:15:43 user nova-compute[73068]: DEBUG nova.objects.instance [None req-8488d8d0-cbce-4ef0-9ca5-d294e14adc89 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'flavor' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:15:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:44 user nova-compute[73068]: DEBUG nova.compute.manager [req-47931ad3-36d0-4f59-bf54-3ae1ce3862c6 req-674b5a66-6000-4c9a-9979-53ba211d2191 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-unplugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:15:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-47931ad3-36d0-4f59-bf54-3ae1ce3862c6 req-674b5a66-6000-4c9a-9979-53ba211d2191 service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:15:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-47931ad3-36d0-4f59-bf54-3ae1ce3862c6 req-674b5a66-6000-4c9a-9979-53ba211d2191 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:15:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-47931ad3-36d0-4f59-bf54-3ae1ce3862c6 req-674b5a66-6000-4c9a-9979-53ba211d2191 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:15:44 user nova-compute[73068]: DEBUG nova.compute.manager [req-47931ad3-36d0-4f59-bf54-3ae1ce3862c6 req-674b5a66-6000-4c9a-9979-53ba211d2191 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-unplugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:15:44 user nova-compute[73068]: WARNING nova.compute.manager [req-47931ad3-36d0-4f59-bf54-3ae1ce3862c6 req-674b5a66-6000-4c9a-9979-53ba211d2191 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received unexpected event network-vif-unplugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with vm_state rescued and task_state unrescuing.
Aug 26 12:15:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:44 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:15:44 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Instance destroyed successfully.
Aug 26 12:15:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:15:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:15:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:15:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:15:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:15:46 user nova-compute[73068]: WARNING nova.compute.manager [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received unexpected event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with vm_state rescued and task_state unrescuing.
Aug 26 12:15:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:15:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:15:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:15:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:15:46 user nova-compute[73068]: DEBUG nova.compute.manager [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:15:46 user nova-compute[73068]: WARNING nova.compute.manager [req-9141d197-eabb-4730-8986-21ab3d72f29a req-9c78e2d8-cad1-4b19-bb65-9422c3f0a81c service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received unexpected event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with vm_state rescued and task_state unrescuing.
Aug 26 12:15:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Removed pending event for 5e0ca353-b75e-4151-ade0-d584bc4f3a95 due to event {{(pid=73068) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 12:15:48 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052148.1465478, 5e0ca353-b75e-4151-ade0-d584bc4f3a95 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:15:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] VM Resumed (Lifecycle Event)
Aug 26 12:15:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8488d8d0-cbce-4ef0-9ca5-d294e14adc89 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:15:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:15:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:15:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 12:15:48 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052148.1475265, 5e0ca353-b75e-4151-ade0-d584bc4f3a95 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:15:48 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] VM Started (Lifecycle Event)
Aug 26 12:15:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:15:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:15:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-37977ce7-d21a-4599-a4c2-4cb1a878583d req-811f5550-e40d-4040-b55a-67b654809e97 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:15:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-37977ce7-d21a-4599-a4c2-4cb1a878583d req-811f5550-e40d-4040-b55a-67b654809e97 service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:15:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-37977ce7-d21a-4599-a4c2-4cb1a878583d req-811f5550-e40d-4040-b55a-67b654809e97 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:15:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-37977ce7-d21a-4599-a4c2-4cb1a878583d req-811f5550-e40d-4040-b55a-67b654809e97 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:15:48 user nova-compute[73068]: DEBUG nova.compute.manager [req-37977ce7-d21a-4599-a4c2-4cb1a878583d req-811f5550-e40d-4040-b55a-67b654809e97 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:15:48 user nova-compute[73068]: WARNING nova.compute.manager [req-37977ce7-d21a-4599-a4c2-4cb1a878583d req-811f5550-e40d-4040-b55a-67b654809e97 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received unexpected event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with vm_state active and task_state None.
Aug 26 12:15:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:15:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:16:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:15 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:16:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:16:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:16:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:16:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:16:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:16:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:16:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:16:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:16:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:16:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:16:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:16:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:16:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:16:18 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:16:18 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:16:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8407MB free_disk=25.18236541748047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance efcec8a5-ee86-4792-8fe9-5895904d87e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:16:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:16:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:16:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:16:20 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:16:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:21 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:16:21 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:16:23 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:16:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:16:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:16:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:16:23 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:16:24 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updating instance_info_cache with network_info: [{"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:16:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:16:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:16:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:16:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:16:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:16:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:16:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-ec0a7dd8-018d-4ef2-85e3-8b5ef31d77c1 req-fae42393-e148-47fa-922e-2ac973d9692d service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-changed-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:16:59 user nova-compute[73068]: DEBUG nova.compute.manager [req-ec0a7dd8-018d-4ef2-85e3-8b5ef31d77c1 req-fae42393-e148-47fa-922e-2ac973d9692d service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Refreshing instance network info cache due to event network-changed-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:16:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ec0a7dd8-018d-4ef2-85e3-8b5ef31d77c1 req-fae42393-e148-47fa-922e-2ac973d9692d service nova] Acquiring lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:16:59 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ec0a7dd8-018d-4ef2-85e3-8b5ef31d77c1 req-fae42393-e148-47fa-922e-2ac973d9692d service nova] Acquired lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:16:59 user nova-compute[73068]: DEBUG nova.network.neutron [req-ec0a7dd8-018d-4ef2-85e3-8b5ef31d77c1 req-fae42393-e148-47fa-922e-2ac973d9692d service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Refreshing network info cache for port 8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:17:00 user nova-compute[73068]: DEBUG nova.network.neutron [req-ec0a7dd8-018d-4ef2-85e3-8b5ef31d77c1 req-fae42393-e148-47fa-922e-2ac973d9692d service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Updated VIF entry in instance network info cache for port 8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:17:00 user nova-compute[73068]: DEBUG nova.network.neutron [req-ec0a7dd8-018d-4ef2-85e3-8b5ef31d77c1 req-fae42393-e148-47fa-922e-2ac973d9692d service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Updating instance_info_cache with network_info: [{"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:17:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-ec0a7dd8-018d-4ef2-85e3-8b5ef31d77c1 req-fae42393-e148-47fa-922e-2ac973d9692d service nova] Releasing lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:17:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "793f0867-3360-4292-92c3-694f5a61ec1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:17:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "793f0867-3360-4292-92c3-694f5a61ec1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:17:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:17:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:17:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:17:14 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:17:14 user nova-compute[73068]: INFO nova.compute.claims [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Claim successful on node user
Aug 26 12:17:14 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:17:15 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:17:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:17:15 user nova-compute[73068]: INFO nova.virt.block_device [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Booting with volume 153853cc-5a79-49b9-a1eb-78f00569e322 at /dev/vda
Aug 26 12:17:15 user nova-compute[73068]: DEBUG nova.policy [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c7914d369aa429394c647f73846fe5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681694efee294a74b277fced3266643d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG os_brick.utils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d0f952-a5b8-4dcf-869c-dd50f39698fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[83056bac-e9a4-4355-aa6f-1c37308e9bec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ecf27c-0c74-44fc-a6e2-2ea090c41687]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a6afa2-a57c-4a33-9b51-d0211caa6389]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:17:15 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:17:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e1e466-f452-4bbd-89f8-92ae962741f2]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG os_brick.utils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Updating existing volume attachment record: a6d5b588-f483-4ca2-bd40-fae409bf3564 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:17:15 user nova-compute[73068]: DEBUG nova.network.neutron [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Successfully created port: ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Successfully updated port: ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquired lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-e04e0e88-79ab-4bc2-b16a-a73ca73bbbad req-75fb0980-e1c2-4cc2-8089-88f1263c2c19 service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received event network-changed-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG nova.compute.manager [req-e04e0e88-79ab-4bc2-b16a-a73ca73bbbad req-75fb0980-e1c2-4cc2-8089-88f1263c2c19 service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Refreshing instance network info cache due to event network-changed-ae8e00ed-932f-431c-8d86-b9cdf83219d9. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e04e0e88-79ab-4bc2-b16a-a73ca73bbbad req-75fb0980-e1c2-4cc2-8089-88f1263c2c19 service nova] Acquiring lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG nova.network.neutron [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG nova.network.neutron [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Updating instance_info_cache with network_info: [{"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Releasing lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG nova.compute.manager [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Instance network_info: |[{"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e04e0e88-79ab-4bc2-b16a-a73ca73bbbad req-75fb0980-e1c2-4cc2-8089-88f1263c2c19 service nova] Acquired lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG nova.network.neutron [req-e04e0e88-79ab-4bc2-b16a-a73ca73bbbad req-75fb0980-e1c2-4cc2-8089-88f1263c2c19 service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Refreshing network info cache for port ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG nova.network.neutron [req-e04e0e88-79ab-4bc2-b16a-a73ca73bbbad req-75fb0980-e1c2-4cc2-8089-88f1263c2c19 service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Updated VIF entry in instance network info cache for port ae8e00ed-932f-431c-8d86-b9cdf83219d9. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG nova.network.neutron [req-e04e0e88-79ab-4bc2-b16a-a73ca73bbbad req-75fb0980-e1c2-4cc2-8089-88f1263c2c19 service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Updating instance_info_cache with network_info: [{"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-e04e0e88-79ab-4bc2-b16a-a73ca73bbbad req-75fb0980-e1c2-4cc2-8089-88f1263c2c19 service nova] Releasing lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:17 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:17:18 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:17:18 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8511MB free_disk=25.181236267089844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance efcec8a5-ee86-4792-8fe9-5895904d87e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 793f0867-3360-4292-92c3-694f5a61ec1f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:17:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:17:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:17:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:17:19 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:17:20 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:17:20 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:17:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:21 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:17:22 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Skipping network cache update for instance because it is Building. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:17:25 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Creating image(s)
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Did not create local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Ensure instance console log exists: /opt/stack/data/nova/instances/793f0867-3360-4292-92c3-694f5a61ec1f/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Start _get_guest_xml network_info=[{"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'a6d5b588-f483-4ca2-bd40-fae409bf3564', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'faXnyijr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '793f0867-3360-4292-92c3-694f5a61ec1f', 'attached_at': '', 'detached_at': '', 'volume_id': '153853cc-5a79-49b9-a1eb-78f00569e322', 'serial': '153853cc-5a79-49b9-a1eb-78f00569e322'}, 'device_type': 'disk', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'guest_format': None, 'volume_type': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:17:25 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:17:25 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'faXnyijr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:17:25 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:17:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:17:25 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:17:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:17:25 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[713fadd4-2ceb-45ee-8c65-55690231c18d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:17:25 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab5c11a-fefc-4df9-90d3-c277e278d819]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322] added
Aug 26 12:17:25 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1deb79-7286-4e96-abe9-bfe8335e7573]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7072b436-ff3e-4ef4-919b-86d9c91a75ac]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:25 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v faXnyijr {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v faXnyijr" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a4f9b0-c024-422f-9ae5-f98ffa844204]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'faXnyijr'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce92adb-158f-4350-8db0-a7d37409f385]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b6b686-80e3-4c32-82c5-0d8580d65d17]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:17:26 user nova-compute[73068]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:17:26 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:17:26 user nova-compute[73068]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:17:26 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updating instance_info_cache with network_info: [{"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a3500d-5773-4838-bca4-92bdf8e850ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322, portal: 172.16.0.220,3260]
Aug 26 12:17:26 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322, portal: 172.16.0.220,3260] successful.
Aug 26 12:17:26 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[332a6b39-aebd-4c61-bb54-979358d5e2a4]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46ba449-69bb-4676-b3b0-509494c6ad3c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:17:26 user nova-compute[73068]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:17:26 user nova-compute[73068]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 (non-flash)
Aug 26 12:17:26 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:17:26 user nova-compute[73068]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:17:26 user nova-compute[73068]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 (non-flash)
Aug 26 12:17:26 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9885906e-0e03-46e6-bc9b-380841649a1f]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:26 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'faXnyijr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23364666630616361', 'path': '/dev/sdd'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364666630616361', 'path': '/dev/sdd'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1788334971',display_name='tempest-TestVolumeBootPattern-server-1788334971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1788334971',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGGbDW4IRPfWF2oDe7BnqRb6o5JLW4b+4VkEEmTq+OSUSPTsa+5KbFcPMJM3eoijlk/fK/7tW9d21OBnSGqw6nSrw3X4hF4egAzXJPAe2/Rr0+ZAV+DpkZLHfAspD9LzA==',key_name='tempest-TestVolumeBootPattern-888567676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-lqr0advh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:17:15Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=793f0867-3360-4292-92c3-694f5a61ec1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:22:04,bridge_name='br-int',has_traffic_filtering=True,id=ae8e00ed-932f-431c-8d86-b9cdf83219d9,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8e00ed-93') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG nova.objects.instance [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'pci_devices' on Instance uuid 793f0867-3360-4292-92c3-694f5a61ec1f {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:17:27 user nova-compute[73068]:   <uuid>793f0867-3360-4292-92c3-694f5a61ec1f</uuid>
Aug 26 12:17:27 user nova-compute[73068]:   <name>instance-00000032</name>
Aug 26 12:17:27 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:17:27 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:17:27 user nova-compute[73068]:   <metadata>
Aug 26 12:17:27 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:17:27 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:17:27 user nova-compute[73068]:       <nova:name>tempest-TestVolumeBootPattern-server-1788334971</nova:name>
Aug 26 12:17:27 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:17:25</nova:creationTime>
Aug 26 12:17:27 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:17:27 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:17:27 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:17:27 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:17:27 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:17:27 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:17:27 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:17:27 user nova-compute[73068]:       <nova:owner>
Aug 26 12:17:27 user nova-compute[73068]:         <nova:user uuid="1c7914d369aa429394c647f73846fe5a">tempest-TestVolumeBootPattern-731970169-project-member</nova:user>
Aug 26 12:17:27 user nova-compute[73068]:         <nova:project uuid="681694efee294a74b277fced3266643d">tempest-TestVolumeBootPattern-731970169</nova:project>
Aug 26 12:17:27 user nova-compute[73068]:       </nova:owner>
Aug 26 12:17:27 user nova-compute[73068]:       <nova:ports>
Aug 26 12:17:27 user nova-compute[73068]:         <nova:port uuid="ae8e00ed-932f-431c-8d86-b9cdf83219d9">
Aug 26 12:17:27 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 12:17:27 user nova-compute[73068]:         </nova:port>
Aug 26 12:17:27 user nova-compute[73068]:       </nova:ports>
Aug 26 12:17:27 user nova-compute[73068]:     </nova:instance>
Aug 26 12:17:27 user nova-compute[73068]:   </metadata>
Aug 26 12:17:27 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:17:27 user nova-compute[73068]:     <system>
Aug 26 12:17:27 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:17:27 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:17:27 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:17:27 user nova-compute[73068]:       <entry name="serial">793f0867-3360-4292-92c3-694f5a61ec1f</entry>
Aug 26 12:17:27 user nova-compute[73068]:       <entry name="uuid">793f0867-3360-4292-92c3-694f5a61ec1f</entry>
Aug 26 12:17:27 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:17:27 user nova-compute[73068]:     </system>
Aug 26 12:17:27 user nova-compute[73068]:   </sysinfo>
Aug 26 12:17:27 user nova-compute[73068]:   <os>
Aug 26 12:17:27 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:17:27 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:17:27 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:17:27 user nova-compute[73068]:   </os>
Aug 26 12:17:27 user nova-compute[73068]:   <features>
Aug 26 12:17:27 user nova-compute[73068]:     <acpi/>
Aug 26 12:17:27 user nova-compute[73068]:     <apic/>
Aug 26 12:17:27 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:17:27 user nova-compute[73068]:   </features>
Aug 26 12:17:27 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:17:27 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:17:27 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:17:27 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:17:27 user nova-compute[73068]:   </clock>
Aug 26 12:17:27 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:17:27 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:17:27 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:17:27 user nova-compute[73068]:   </cpu>
Aug 26 12:17:27 user nova-compute[73068]:   <devices>
Aug 26 12:17:27 user nova-compute[73068]:     <disk type="block" device="disk">
Aug 26 12:17:27 user nova-compute[73068]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:17:27 user nova-compute[73068]:       <source dev="/dev/sdd"/>
Aug 26 12:17:27 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:17:27 user nova-compute[73068]:       <serial>153853cc-5a79-49b9-a1eb-78f00569e322</serial>
Aug 26 12:17:27 user nova-compute[73068]:     </disk>
Aug 26 12:17:27 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:17:27 user nova-compute[73068]:       <mac address="fa:16:3e:45:22:04"/>
Aug 26 12:17:27 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:17:27 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:17:27 user nova-compute[73068]:       <target dev="tapae8e00ed-93"/>
Aug 26 12:17:27 user nova-compute[73068]:     </interface>
Aug 26 12:17:27 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:17:27 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/793f0867-3360-4292-92c3-694f5a61ec1f/console.log" append="off"/>
Aug 26 12:17:27 user nova-compute[73068]:     </serial>
Aug 26 12:17:27 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:17:27 user nova-compute[73068]:     <video>
Aug 26 12:17:27 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:17:27 user nova-compute[73068]:     </video>
Aug 26 12:17:27 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:17:27 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:17:27 user nova-compute[73068]:     </rng>
Aug 26 12:17:27 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:17:27 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:17:27 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:17:27 user nova-compute[73068]:     </memballoon>
Aug 26 12:17:27 user nova-compute[73068]:   </devices>
Aug 26 12:17:27 user nova-compute[73068]: </domain>
Aug 26 12:17:27 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1788334971',display_name='tempest-TestVolumeBootPattern-server-1788334971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1788334971',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGGbDW4IRPfWF2oDe7BnqRb6o5JLW4b+4VkEEmTq+OSUSPTsa+5KbFcPMJM3eoijlk/fK/7tW9d21OBnSGqw6nSrw3X4hF4egAzXJPAe2/Rr0+ZAV+DpkZLHfAspD9LzA==',key_name='tempest-TestVolumeBootPattern-888567676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-lqr0advh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:17:15Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=793f0867-3360-4292-92c3-694f5a61ec1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:22:04,bridge_name='br-int',has_traffic_filtering=True,id=ae8e00ed-932f-431c-8d86-b9cdf83219d9,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8e00ed-93') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG os_vif [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:22:04,bridge_name='br-int',has_traffic_filtering=True,id=ae8e00ed-932f-431c-8d86-b9cdf83219d9,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8e00ed-93') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae8e00ed-93, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae8e00ed-93, col_values=(('external_ids', {'iface-id': 'ae8e00ed-932f-431c-8d86-b9cdf83219d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:22:04', 'vm-uuid': '793f0867-3360-4292-92c3-694f5a61ec1f'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:27 user nova-compute[73068]: INFO os_vif [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:22:04,bridge_name='br-int',has_traffic_filtering=True,id=ae8e00ed-932f-431c-8d86-b9cdf83219d9,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8e00ed-93')
Aug 26 12:17:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:17:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] No VIF found with MAC fa:16:3e:45:22:04, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:17:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-67d017f4-9d9d-4812-b1cc-361cb2c70e80 req-20a1bf3d-2863-405b-88bc-006165df72f3 service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received event network-vif-plugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:17:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-67d017f4-9d9d-4812-b1cc-361cb2c70e80 req-20a1bf3d-2863-405b-88bc-006165df72f3 service nova] Acquiring lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:17:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-67d017f4-9d9d-4812-b1cc-361cb2c70e80 req-20a1bf3d-2863-405b-88bc-006165df72f3 service nova] Lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:17:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-67d017f4-9d9d-4812-b1cc-361cb2c70e80 req-20a1bf3d-2863-405b-88bc-006165df72f3 service nova] Lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:17:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-67d017f4-9d9d-4812-b1cc-361cb2c70e80 req-20a1bf3d-2863-405b-88bc-006165df72f3 service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] No waiting events found dispatching network-vif-plugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:17:28 user nova-compute[73068]: WARNING nova.compute.manager [req-67d017f4-9d9d-4812-b1cc-361cb2c70e80 req-20a1bf3d-2863-405b-88bc-006165df72f3 service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received unexpected event network-vif-plugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 for instance with vm_state building and task_state spawning.
Aug 26 12:17:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052250.5798628, 793f0867-3360-4292-92c3-694f5a61ec1f => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:17:30 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] VM Resumed (Lifecycle Event)
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:17:30 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Instance spawned successfully.
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:17:30 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052250.5813775, 793f0867-3360-4292-92c3-694f5a61ec1f => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:17:30 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] VM Started (Lifecycle Event)
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:17:30 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:17:30 user nova-compute[73068]: INFO nova.compute.manager [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Took 4.85 seconds to spawn the instance on the hypervisor.
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-c792aaa9-132e-412c-80f6-12f3f2fb9525 req-7456bffb-e762-4247-9ff4-5caf1cd83a9a service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received event network-vif-plugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c792aaa9-132e-412c-80f6-12f3f2fb9525 req-7456bffb-e762-4247-9ff4-5caf1cd83a9a service nova] Acquiring lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c792aaa9-132e-412c-80f6-12f3f2fb9525 req-7456bffb-e762-4247-9ff4-5caf1cd83a9a service nova] Lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c792aaa9-132e-412c-80f6-12f3f2fb9525 req-7456bffb-e762-4247-9ff4-5caf1cd83a9a service nova] Lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:17:30 user nova-compute[73068]: DEBUG nova.compute.manager [req-c792aaa9-132e-412c-80f6-12f3f2fb9525 req-7456bffb-e762-4247-9ff4-5caf1cd83a9a service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] No waiting events found dispatching network-vif-plugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:17:30 user nova-compute[73068]: WARNING nova.compute.manager [req-c792aaa9-132e-412c-80f6-12f3f2fb9525 req-7456bffb-e762-4247-9ff4-5caf1cd83a9a service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received unexpected event network-vif-plugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 for instance with vm_state building and task_state spawning.
Aug 26 12:17:30 user nova-compute[73068]: INFO nova.compute.manager [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Took 16.06 seconds to build instance.
Aug 26 12:17:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-037cbfa4-07e0-4a73-9196-fea92ea78be6 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "793f0867-3360-4292-92c3-694f5a61ec1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.192s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:17:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-4c280ee2-9d22-4e99-a789-f9768e81b6d2 req-3f8dd410-7f8e-4774-a51c-cbec861b9a11 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-changed-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:17:35 user nova-compute[73068]: DEBUG nova.compute.manager [req-4c280ee2-9d22-4e99-a789-f9768e81b6d2 req-3f8dd410-7f8e-4774-a51c-cbec861b9a11 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Refreshing instance network info cache due to event network-changed-06493bcb-982f-4924-8f2c-48e783f0146f. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:17:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4c280ee2-9d22-4e99-a789-f9768e81b6d2 req-3f8dd410-7f8e-4774-a51c-cbec861b9a11 service nova] Acquiring lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:17:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4c280ee2-9d22-4e99-a789-f9768e81b6d2 req-3f8dd410-7f8e-4774-a51c-cbec861b9a11 service nova] Acquired lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:17:35 user nova-compute[73068]: DEBUG nova.network.neutron [req-4c280ee2-9d22-4e99-a789-f9768e81b6d2 req-3f8dd410-7f8e-4774-a51c-cbec861b9a11 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Refreshing network info cache for port 06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:17:36 user nova-compute[73068]: INFO nova.compute.manager [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Detaching volume b073d255-14bb-48be-a535-c2a85a212624
Aug 26 12:17:36 user nova-compute[73068]: INFO nova.virt.block_device [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Attempting to driver detach volume b073d255-14bb-48be-a535-c2a85a212624 from mountpoint /dev/vdb
Aug 26 12:17:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Attempting to detach device vdb from instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:17:36 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:17:36 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 12:17:36 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:17:36 user nova-compute[73068]:   <serial>b073d255-14bb-48be-a535-c2a85a212624</serial>
Aug 26 12:17:36 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:17:36 user nova-compute[73068]: </disk>
Aug 26 12:17:36 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:17:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Successfully detached device vdb from instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 from the persistent domain config.
Aug 26 12:17:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:17:36 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:17:36 user nova-compute[73068]:   <source dev="/dev/sdc"/>
Aug 26 12:17:36 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:17:36 user nova-compute[73068]:   <serial>b073d255-14bb-48be-a535-c2a85a212624</serial>
Aug 26 12:17:36 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:17:36 user nova-compute[73068]: </disk>
Aug 26 12:17:36 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG nova.network.neutron [req-4c280ee2-9d22-4e99-a789-f9768e81b6d2 req-3f8dd410-7f8e-4774-a51c-cbec861b9a11 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updated VIF entry in instance network info cache for port 06493bcb-982f-4924-8f2c-48e783f0146f. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG nova.network.neutron [req-4c280ee2-9d22-4e99-a789-f9768e81b6d2 req-3f8dd410-7f8e-4774-a51c-cbec861b9a11 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updating instance_info_cache with network_info: [{"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-4c280ee2-9d22-4e99-a789-f9768e81b6d2 req-3f8dd410-7f8e-4774-a51c-cbec861b9a11 service nova] Releasing lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693052256.67432, 5e0ca353-b75e-4151-ade0-d584bc4f3a95 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 12:17:36 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Successfully detached device vdb from instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 from the live domain config.
Aug 26 12:17:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OvHlAfoI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:17:36 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd7751f-1c30-40fd-bb62-2d2fab31393a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[114a3e10-2d9a-4e5e-b1bf-fd2fa4b8c38b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:17:36 user nova-compute[73068]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:17:36 user nova-compute[73068]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 (non-flash)
Aug 26 12:17:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 (non-flash)
Aug 26 12:17:36 user nova-compute[73068]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:17:36 user nova-compute[73068]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 (non-flash)
Aug 26 12:17:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddbf7e4700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624'): ({'sdc'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Removing single pathed devices sdc {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0ca5c4-c52a-4034-af78-5b415b3a56bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[740bcb7d-3f1d-485f-9fd5-7aab84e59c78]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Flushing IO for device /dev/sdc {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50219f1-ebab-4cb6-a3cd-d793dac6da3d]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7508c49c-e3d4-4cc2-ae9b-9b49d85b589c]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] SCSI volumes sdc have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[70982938-f51d-4a09-9e9b-6a68feab4a27]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f590d3b-bc46-40ce-843d-ed6f3a5a8b4c]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624, portal: 172.16.0.220,3260]
Aug 26 12:17:36 user nova-compute[73068]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624, portal: 172.16.0.220,3260] successful.
Aug 26 12:17:36 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b073d255-14bb-48be-a535-c2a85a212624 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59cbe75-5cc9-43e8-83ef-16ef2189c234]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] <== disconnect_volume: return (264ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:17:36 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:17:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:37 user nova-compute[73068]: DEBUG nova.objects.instance [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'flavor' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:17:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-3104f385-65e5-4a3b-9157-01d4a18e7e33 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.656s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:17:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-818b54d6-d74d-4185-ba91-114f9b027e2f req-b691caf0-0583-45ca-8301-9ccf3bcb1f0a service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-changed-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:17:37 user nova-compute[73068]: DEBUG nova.compute.manager [req-818b54d6-d74d-4185-ba91-114f9b027e2f req-b691caf0-0583-45ca-8301-9ccf3bcb1f0a service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Refreshing instance network info cache due to event network-changed-06493bcb-982f-4924-8f2c-48e783f0146f. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:17:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-818b54d6-d74d-4185-ba91-114f9b027e2f req-b691caf0-0583-45ca-8301-9ccf3bcb1f0a service nova] Acquiring lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:17:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-818b54d6-d74d-4185-ba91-114f9b027e2f req-b691caf0-0583-45ca-8301-9ccf3bcb1f0a service nova] Acquired lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:17:37 user nova-compute[73068]: DEBUG nova.network.neutron [req-818b54d6-d74d-4185-ba91-114f9b027e2f req-b691caf0-0583-45ca-8301-9ccf3bcb1f0a service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Refreshing network info cache for port 06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:17:38 user nova-compute[73068]: DEBUG nova.network.neutron [req-818b54d6-d74d-4185-ba91-114f9b027e2f req-b691caf0-0583-45ca-8301-9ccf3bcb1f0a service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updated VIF entry in instance network info cache for port 06493bcb-982f-4924-8f2c-48e783f0146f. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:17:38 user nova-compute[73068]: DEBUG nova.network.neutron [req-818b54d6-d74d-4185-ba91-114f9b027e2f req-b691caf0-0583-45ca-8301-9ccf3bcb1f0a service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updating instance_info_cache with network_info: [{"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:17:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-818b54d6-d74d-4185-ba91-114f9b027e2f req-b691caf0-0583-45ca-8301-9ccf3bcb1f0a service nova] Releasing lock "refresh_cache-5e0ca353-b75e-4151-ade0-d584bc4f3a95" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:17:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:17:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:17:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:17:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:17:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:17:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:17:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:18:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:18:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:18:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:18:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:18:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:18:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:18:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:18:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:18:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:18:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:18:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:18:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:18:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:18:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:18:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:18:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:18:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:18:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:18:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:18:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:18:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:18:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:18:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:18:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:18:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:18:20 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:18:20 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8395MB free_disk=25.17963409423828GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance efcec8a5-ee86-4792-8fe9-5895904d87e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 793f0867-3360-4292-92c3-694f5a61ec1f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:18:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:18:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:18:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:25 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:18:26 user nova-compute[73068]: INFO nova.compute.manager [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Terminating instance
Aug 26 12:18:26 user nova-compute[73068]: DEBUG nova.compute.manager [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-6a52abfd-2c0a-45dc-a06a-4699836cf8e3 req-8c9a5bf1-79a5-4fc4-b939-dfa893591330 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-unplugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6a52abfd-2c0a-45dc-a06a-4699836cf8e3 req-8c9a5bf1-79a5-4fc4-b939-dfa893591330 service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6a52abfd-2c0a-45dc-a06a-4699836cf8e3 req-8c9a5bf1-79a5-4fc4-b939-dfa893591330 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6a52abfd-2c0a-45dc-a06a-4699836cf8e3 req-8c9a5bf1-79a5-4fc4-b939-dfa893591330 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-6a52abfd-2c0a-45dc-a06a-4699836cf8e3 req-8c9a5bf1-79a5-4fc4-b939-dfa893591330 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-unplugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG nova.compute.manager [req-6a52abfd-2c0a-45dc-a06a-4699836cf8e3 req-8c9a5bf1-79a5-4fc4-b939-dfa893591330 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-unplugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:18:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updating instance_info_cache with network_info: [{"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-6dfa783d-8910-4e63-bbf5-8d803c1b26eb" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:27 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Instance destroyed successfully.
Aug 26 12:18:27 user nova-compute[73068]: DEBUG nova.objects.instance [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'resources' on Instance uuid 5e0ca353-b75e-4151-ade0-d584bc4f3a95 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:11:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-997970284',display_name='tempest-ServerRescueNegativeTestJSON-server-997970284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-997970284',id=47,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGNqrNjpKjB5tf/MlJjtAHzXEy3U5o0Xywa50RXl1WH2sf5SInDvXxv+4Ym2jmPD29nsAyrrE5wNRhrS4lYSUD1dSTnf391k48oCtunQh9h5w7tmX9iIJZI2ySEZfgYBA==',key_name='tempest-keypair-1253249556',keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-j31t0pyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39a8587c93764774ac04c74f11ed6498',uuid=5e0ca353-b75e-4151-ade0-d584bc4f3a95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "06493bcb-982f-4924-8f2c-48e783f0146f", "address": "fa:16:3e:ae:19:20", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06493bcb-98", "ovs_interfaceid": "06493bcb-982f-4924-8f2c-48e783f0146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:19:20,bridge_name='br-int',has_traffic_filtering=True,id=06493bcb-982f-4924-8f2c-48e783f0146f,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06493bcb-98') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG os_vif [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:19:20,bridge_name='br-int',has_traffic_filtering=True,id=06493bcb-982f-4924-8f2c-48e783f0146f,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06493bcb-98') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06493bcb-98, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:18:27 user nova-compute[73068]: INFO os_vif [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:19:20,bridge_name='br-int',has_traffic_filtering=True,id=06493bcb-982f-4924-8f2c-48e783f0146f,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06493bcb-98')
Aug 26 12:18:27 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Deleting instance files /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95_del
Aug 26 12:18:27 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Deletion of /opt/stack/data/nova/instances/5e0ca353-b75e-4151-ade0-d584bc4f3a95_del complete
Aug 26 12:18:27 user nova-compute[73068]: INFO nova.compute.manager [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 26 12:18:27 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:18:27 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:18:28 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Took 1.20 seconds to deallocate network for instance.
Aug 26 12:18:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-3723e9e6-a768-4442-b816-3b674cb0beb0 req-f19e0fa9-836f-4d49-9be8-8811745e83dc service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-deleted-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:18:28 user nova-compute[73068]: INFO nova.compute.manager [req-3723e9e6-a768-4442-b816-3b674cb0beb0 req-f19e0fa9-836f-4d49-9be8-8811745e83dc service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Neutron deleted interface 06493bcb-982f-4924-8f2c-48e783f0146f; detaching it from the instance and deleting it from the info cache
Aug 26 12:18:28 user nova-compute[73068]: DEBUG nova.network.neutron [req-3723e9e6-a768-4442-b816-3b674cb0beb0 req-f19e0fa9-836f-4d49-9be8-8811745e83dc service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-3723e9e6-a768-4442-b816-3b674cb0beb0 req-f19e0fa9-836f-4d49-9be8-8811745e83dc service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Detach interface failed, port_id=06493bcb-982f-4924-8f2c-48e783f0146f, reason: Instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95 could not be found. {{(pid=73068) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-b09d1211-e372-4931-a41e-eaf719a94196 req-722e81a4-74dc-436b-9656-d00b9f7ca154 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b09d1211-e372-4931-a41e-eaf719a94196 req-722e81a4-74dc-436b-9656-d00b9f7ca154 service nova] Acquiring lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b09d1211-e372-4931-a41e-eaf719a94196 req-722e81a4-74dc-436b-9656-d00b9f7ca154 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-b09d1211-e372-4931-a41e-eaf719a94196 req-722e81a4-74dc-436b-9656-d00b9f7ca154 service nova] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:18:28 user nova-compute[73068]: DEBUG nova.compute.manager [req-b09d1211-e372-4931-a41e-eaf719a94196 req-722e81a4-74dc-436b-9656-d00b9f7ca154 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] No waiting events found dispatching network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:18:28 user nova-compute[73068]: WARNING nova.compute.manager [req-b09d1211-e372-4931-a41e-eaf719a94196 req-722e81a4-74dc-436b-9656-d00b9f7ca154 service nova] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Received unexpected event network-vif-plugged-06493bcb-982f-4924-8f2c-48e783f0146f for instance with vm_state deleted and task_state None.
Aug 26 12:18:28 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Deleted allocations for instance 5e0ca353-b75e-4151-ade0-d584bc4f3a95
Aug 26 12:18:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-900d2ee4-d581-47e4-a618-5063b88753b1 tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "5e0ca353-b75e-4151-ade0-d584bc4f3a95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.481s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:18:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:18:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:18:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:18:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:18:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:37 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:41 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 12:18:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 12:18:42 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693052307.202671, 5e0ca353-b75e-4151-ade0-d584bc4f3a95 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:18:42 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] VM Stopped (Lifecycle Event)
Aug 26 12:18:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-29e58791-e1b1-478e-8260-cdf9cbcd6519 None None] [instance: 5e0ca353-b75e-4151-ade0-d584bc4f3a95] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:18:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:18:50 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:18:50 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 12:18:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:18:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:19:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-6af9e604-c6aa-4c03-84af-c04b2b5f0da6 req-10be2eed-61f6-406d-a399-007e8221f52e service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received event network-changed-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:19:06 user nova-compute[73068]: DEBUG nova.compute.manager [req-6af9e604-c6aa-4c03-84af-c04b2b5f0da6 req-10be2eed-61f6-406d-a399-007e8221f52e service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Refreshing instance network info cache due to event network-changed-ae8e00ed-932f-431c-8d86-b9cdf83219d9. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:19:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6af9e604-c6aa-4c03-84af-c04b2b5f0da6 req-10be2eed-61f6-406d-a399-007e8221f52e service nova] Acquiring lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:19:06 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6af9e604-c6aa-4c03-84af-c04b2b5f0da6 req-10be2eed-61f6-406d-a399-007e8221f52e service nova] Acquired lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:19:06 user nova-compute[73068]: DEBUG nova.network.neutron [req-6af9e604-c6aa-4c03-84af-c04b2b5f0da6 req-10be2eed-61f6-406d-a399-007e8221f52e service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Refreshing network info cache for port ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:19:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:07 user nova-compute[73068]: DEBUG nova.network.neutron [req-6af9e604-c6aa-4c03-84af-c04b2b5f0da6 req-10be2eed-61f6-406d-a399-007e8221f52e service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Updated VIF entry in instance network info cache for port ae8e00ed-932f-431c-8d86-b9cdf83219d9. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:19:07 user nova-compute[73068]: DEBUG nova.network.neutron [req-6af9e604-c6aa-4c03-84af-c04b2b5f0da6 req-10be2eed-61f6-406d-a399-007e8221f52e service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Updating instance_info_cache with network_info: [{"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:19:07 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-6af9e604-c6aa-4c03-84af-c04b2b5f0da6 req-10be2eed-61f6-406d-a399-007e8221f52e service nova] Releasing lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-586048fe-89ae-4d2d-a4e5-138e4e259268 req-9e7c964f-a616-4a69-ab83-2c22d738b2ef service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received event network-changed-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG nova.compute.manager [req-586048fe-89ae-4d2d-a4e5-138e4e259268 req-9e7c964f-a616-4a69-ab83-2c22d738b2ef service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Refreshing instance network info cache due to event network-changed-ae8e00ed-932f-431c-8d86-b9cdf83219d9. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-586048fe-89ae-4d2d-a4e5-138e4e259268 req-9e7c964f-a616-4a69-ab83-2c22d738b2ef service nova] Acquiring lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-586048fe-89ae-4d2d-a4e5-138e4e259268 req-9e7c964f-a616-4a69-ab83-2c22d738b2ef service nova] Acquired lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG nova.network.neutron [req-586048fe-89ae-4d2d-a4e5-138e4e259268 req-9e7c964f-a616-4a69-ab83-2c22d738b2ef service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Refreshing network info cache for port ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "793f0867-3360-4292-92c3-694f5a61ec1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "793f0867-3360-4292-92c3-694f5a61ec1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:08 user nova-compute[73068]: INFO nova.compute.manager [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Terminating instance
Aug 26 12:19:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG nova.network.neutron [req-586048fe-89ae-4d2d-a4e5-138e4e259268 req-9e7c964f-a616-4a69-ab83-2c22d738b2ef service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Updated VIF entry in instance network info cache for port ae8e00ed-932f-431c-8d86-b9cdf83219d9. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG nova.network.neutron [req-586048fe-89ae-4d2d-a4e5-138e4e259268 req-9e7c964f-a616-4a69-ab83-2c22d738b2ef service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Updating instance_info_cache with network_info: [{"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-586048fe-89ae-4d2d-a4e5-138e4e259268 req-9e7c964f-a616-4a69-ab83-2c22d738b2ef service nova] Releasing lock "refresh_cache-793f0867-3360-4292-92c3-694f5a61ec1f" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:19:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Instance destroyed successfully.
Aug 26 12:19:09 user nova-compute[73068]: DEBUG nova.objects.instance [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'resources' on Instance uuid 793f0867-3360-4292-92c3-694f5a61ec1f {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1788334971',display_name='tempest-TestVolumeBootPattern-server-1788334971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1788334971',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGGbDW4IRPfWF2oDe7BnqRb6o5JLW4b+4VkEEmTq+OSUSPTsa+5KbFcPMJM3eoijlk/fK/7tW9d21OBnSGqw6nSrw3X4hF4egAzXJPAe2/Rr0+ZAV+DpkZLHfAspD9LzA==',key_name='tempest-TestVolumeBootPattern-888567676',keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:17:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-lqr0advh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:17:31Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=793f0867-3360-4292-92c3-694f5a61ec1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "address": "fa:16:3e:45:22:04", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8e00ed-93", "ovs_interfaceid": "ae8e00ed-932f-431c-8d86-b9cdf83219d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:22:04,bridge_name='br-int',has_traffic_filtering=True,id=ae8e00ed-932f-431c-8d86-b9cdf83219d9,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8e00ed-93') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_vif [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:22:04,bridge_name='br-int',has_traffic_filtering=True,id=ae8e00ed-932f-431c-8d86-b9cdf83219d9,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8e00ed-93') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae8e00ed-93, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:19:09 user nova-compute[73068]: INFO os_vif [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:22:04,bridge_name='br-int',has_traffic_filtering=True,id=ae8e00ed-932f-431c-8d86-b9cdf83219d9,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8e00ed-93')
Aug 26 12:19:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'faXnyijr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:19:09 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1288247d-99f8-4241-bea8-8ff1cfbf2079]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[601ed21c-9404-4094-a145-4af5a41c2dff]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:19:09 user nova-compute[73068]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 (non-flash)
Aug 26 12:19:09 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:19:09 user nova-compute[73068]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 (non-flash)
Aug 26 12:19:09 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb0427010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322'): ({'sdd'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Removing single pathed devices sdd {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b1c4bd-43ec-4baf-add7-d091cb2e3e06]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca4c221-fd58-4e2c-b795-7f79daca20db]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flushing IO for device /dev/sdd {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f53811-93a3-4256-ade9-0d20669e7a4d]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a68f8a1-ad0b-4007-93cd-52a02084fba0]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] SCSI volumes sdd have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd329f48f-3dff0acafa476d9d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d329f48f', '/dev/disk/by-id/scsi-23364666630616361') {{(pid=83861) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a00119-4d31-4351-8497-afd7e132d06a]: (4, None) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.116s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[283af8a2-0100-4db1-b8d8-6f881a634157]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6995810-cca1-49de-8048-33f1f9fb096e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322, portal: 172.16.0.220,3260]
Aug 26 12:19:09 user nova-compute[73068]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322, portal: 172.16.0.220,3260] successful.
Aug 26 12:19:09 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:153853cc-5a79-49b9-a1eb-78f00569e322 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[34df7c0d-3a90-4e98-8764-33f871241a22]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== disconnect_volume: return (379ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:19:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Deleting instance files /opt/stack/data/nova/instances/793f0867-3360-4292-92c3-694f5a61ec1f_del
Aug 26 12:19:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Deletion of /opt/stack/data/nova/instances/793f0867-3360-4292-92c3-694f5a61ec1f_del complete
Aug 26 12:19:09 user nova-compute[73068]: INFO nova.compute.manager [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 26 12:19:09 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:19:09 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:19:10 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:19:10 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Took 0.49 seconds to deallocate network for instance.
Aug 26 12:19:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received event network-vif-unplugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:19:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] Acquiring lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] Lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] Lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] No waiting events found dispatching network-vif-unplugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:19:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received event network-vif-unplugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:19:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received event network-vif-plugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:19:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] Acquiring lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] Lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] Lock "793f0867-3360-4292-92c3-694f5a61ec1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] No waiting events found dispatching network-vif-plugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:19:10 user nova-compute[73068]: WARNING nova.compute.manager [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received unexpected event network-vif-plugged-ae8e00ed-932f-431c-8d86-b9cdf83219d9 for instance with vm_state active and task_state deleting.
Aug 26 12:19:10 user nova-compute[73068]: DEBUG nova.compute.manager [req-268bb7ad-a3f8-4eac-9f0e-c1befd233bf1 req-06a29b19-00dd-45bd-b505-8b78029553ee service nova] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Received event network-vif-deleted-ae8e00ed-932f-431c-8d86-b9cdf83219d9 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:19:11 user nova-compute[73068]: INFO nova.compute.manager [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Took 0.75 seconds to detach 1 volumes for instance.
Aug 26 12:19:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:11 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:19:11 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:19:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:11 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Deleted allocations for instance 793f0867-3360-4292-92c3-694f5a61ec1f
Aug 26 12:19:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f1a0a120-fd6a-4df2-b6da-015d7f1b4f21 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "793f0867-3360-4292-92c3-694f5a61ec1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.816s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:18 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:19:18 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:19:20 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:19:21 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:19:21 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:19:21 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8588MB free_disk=25.206558227539062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:19:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:21 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:19:21 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:19:21 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance efcec8a5-ee86-4792-8fe9-5895904d87e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:19:21 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:19:21 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:19:21 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:19:21 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:19:21 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:19:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:24 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693052349.4186645, 793f0867-3360-4292-92c3-694f5a61ec1f => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:19:24 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] VM Stopped (Lifecycle Event)
Aug 26 12:19:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-7f09ac20-d7cc-4d3d-8ed7-1c4786a421b3 None None] [instance: 793f0867-3360-4292-92c3-694f5a61ec1f] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:19:24 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:25 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:19:25 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:19:25 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:19:25 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:19:27 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:19:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:19:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:19:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:19:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:19:28 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:19:29 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Updating instance_info_cache with network_info: [{"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:19:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:19:29 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:19:29 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:19:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:31 user nova-compute[73068]: INFO nova.compute.manager [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Terminating instance
Aug 26 12:19:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:19:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-8c8af684-95a0-4efe-b030-34d23c103671 req-773fd8bf-8378-435d-9b4c-9bdc3c65dc4a service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received event network-vif-unplugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c8af684-95a0-4efe-b030-34d23c103671 req-773fd8bf-8378-435d-9b4c-9bdc3c65dc4a service nova] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c8af684-95a0-4efe-b030-34d23c103671 req-773fd8bf-8378-435d-9b4c-9bdc3c65dc4a service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-8c8af684-95a0-4efe-b030-34d23c103671 req-773fd8bf-8378-435d-9b4c-9bdc3c65dc4a service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-8c8af684-95a0-4efe-b030-34d23c103671 req-773fd8bf-8378-435d-9b4c-9bdc3c65dc4a service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] No waiting events found dispatching network-vif-unplugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-8c8af684-95a0-4efe-b030-34d23c103671 req-773fd8bf-8378-435d-9b4c-9bdc3c65dc4a service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received event network-vif-unplugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:19:32 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Instance destroyed successfully.
Aug 26 12:19:32 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'resources' on Instance uuid 6dfa783d-8910-4e63-bbf5-8d803c1b26eb {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1718096530',display_name='tempest-ServerRescueNegativeTestJSON-server-1718096530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1718096530',id=43,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:05:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-s770652c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:05:09Z,user_data=None,user_id='39a8587c93764774ac04c74f11ed6498',uuid=6dfa783d-8910-4e63-bbf5-8d803c1b26eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "address": "fa:16:3e:d0:13:0d", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84c41e3f-1f", "ovs_interfaceid": "84c41e3f-1f99-4539-8c53-cec42ff5a06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:13:0d,bridge_name='br-int',has_traffic_filtering=True,id=84c41e3f-1f99-4539-8c53-cec42ff5a06c,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c41e3f-1f') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG os_vif [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:13:0d,bridge_name='br-int',has_traffic_filtering=True,id=84c41e3f-1f99-4539-8c53-cec42ff5a06c,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c41e3f-1f') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84c41e3f-1f, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:19:32 user nova-compute[73068]: INFO os_vif [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:13:0d,bridge_name='br-int',has_traffic_filtering=True,id=84c41e3f-1f99-4539-8c53-cec42ff5a06c,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84c41e3f-1f')
Aug 26 12:19:32 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Deleting instance files /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb_del
Aug 26 12:19:32 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Deletion of /opt/stack/data/nova/instances/6dfa783d-8910-4e63-bbf5-8d803c1b26eb_del complete
Aug 26 12:19:32 user nova-compute[73068]: INFO nova.compute.manager [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 26 12:19:32 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:19:32 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Took 0.50 seconds to deallocate network for instance.
Aug 26 12:19:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:32 user nova-compute[73068]: DEBUG nova.compute.manager [req-1c43e282-9286-45a9-812f-dc1539a634ed req-a299568c-f823-4791-adc1-a2506a521021 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received event network-vif-deleted-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:19:33 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:19:33 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:19:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:33 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Deleted allocations for instance 6dfa783d-8910-4e63-bbf5-8d803c1b26eb
Aug 26 12:19:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b4706432-fe3e-4f09-b5d7-bf58d7417d1d tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.552s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-fb036f00-4960-4802-a06c-49ab7e5ebcee req-8bcb244b-ea82-43f8-b1f1-510cb1b3f217 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:19:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fb036f00-4960-4802-a06c-49ab7e5ebcee req-8bcb244b-ea82-43f8-b1f1-510cb1b3f217 service nova] Acquiring lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:19:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fb036f00-4960-4802-a06c-49ab7e5ebcee req-8bcb244b-ea82-43f8-b1f1-510cb1b3f217 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:19:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-fb036f00-4960-4802-a06c-49ab7e5ebcee req-8bcb244b-ea82-43f8-b1f1-510cb1b3f217 service nova] Lock "6dfa783d-8910-4e63-bbf5-8d803c1b26eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:19:34 user nova-compute[73068]: DEBUG nova.compute.manager [req-fb036f00-4960-4802-a06c-49ab7e5ebcee req-8bcb244b-ea82-43f8-b1f1-510cb1b3f217 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] No waiting events found dispatching network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:19:34 user nova-compute[73068]: WARNING nova.compute.manager [req-fb036f00-4960-4802-a06c-49ab7e5ebcee req-8bcb244b-ea82-43f8-b1f1-510cb1b3f217 service nova] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Received unexpected event network-vif-plugged-84c41e3f-1f99-4539-8c53-cec42ff5a06c for instance with vm_state deleted and task_state None.
Aug 26 12:19:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:19:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:19:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:19:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:19:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:47 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693052372.2762532, 6dfa783d-8910-4e63-bbf5-8d803c1b26eb => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:19:47 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] VM Stopped (Lifecycle Event)
Aug 26 12:19:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a499ae82-1cb2-4ea3-b0c9-3d42f7e08027 None None] [instance: 6dfa783d-8910-4e63-bbf5-8d803c1b26eb] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:19:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:50 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:19:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:19:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-d26016ab-f7a0-4c78-8698-80bab5690a73 req-5a6005a5-1944-447e-be67-dc30b85f820f service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-changed-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-d26016ab-f7a0-4c78-8698-80bab5690a73 req-5a6005a5-1944-447e-be67-dc30b85f820f service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Refreshing instance network info cache due to event network-changed-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d26016ab-f7a0-4c78-8698-80bab5690a73 req-5a6005a5-1944-447e-be67-dc30b85f820f service nova] Acquiring lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d26016ab-f7a0-4c78-8698-80bab5690a73 req-5a6005a5-1944-447e-be67-dc30b85f820f service nova] Acquired lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG nova.network.neutron [req-d26016ab-f7a0-4c78-8698-80bab5690a73 req-5a6005a5-1944-447e-be67-dc30b85f820f service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Refreshing network info cache for port 8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "efcec8a5-ee86-4792-8fe9-5895904d87e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:12 user nova-compute[73068]: INFO nova.compute.manager [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Terminating instance
Aug 26 12:20:12 user nova-compute[73068]: DEBUG nova.compute.manager [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-10d6fd3d-b60c-4bca-b91c-e98d8e1b84a0 req-b3246d1d-480e-4bf3-9db9-f7cec663b7fe service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-vif-unplugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-10d6fd3d-b60c-4bca-b91c-e98d8e1b84a0 req-b3246d1d-480e-4bf3-9db9-f7cec663b7fe service nova] Acquiring lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-10d6fd3d-b60c-4bca-b91c-e98d8e1b84a0 req-b3246d1d-480e-4bf3-9db9-f7cec663b7fe service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-10d6fd3d-b60c-4bca-b91c-e98d8e1b84a0 req-b3246d1d-480e-4bf3-9db9-f7cec663b7fe service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-10d6fd3d-b60c-4bca-b91c-e98d8e1b84a0 req-b3246d1d-480e-4bf3-9db9-f7cec663b7fe service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] No waiting events found dispatching network-vif-unplugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:12 user nova-compute[73068]: DEBUG nova.compute.manager [req-10d6fd3d-b60c-4bca-b91c-e98d8e1b84a0 req-b3246d1d-480e-4bf3-9db9-f7cec663b7fe service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-vif-unplugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG nova.network.neutron [req-d26016ab-f7a0-4c78-8698-80bab5690a73 req-5a6005a5-1944-447e-be67-dc30b85f820f service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Updated VIF entry in instance network info cache for port 8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG nova.network.neutron [req-d26016ab-f7a0-4c78-8698-80bab5690a73 req-5a6005a5-1944-447e-be67-dc30b85f820f service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Updating instance_info_cache with network_info: [{"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d26016ab-f7a0-4c78-8698-80bab5690a73 req-5a6005a5-1944-447e-be67-dc30b85f820f service nova] Releasing lock "refresh_cache-efcec8a5-ee86-4792-8fe9-5895904d87e9" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:13 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Instance destroyed successfully.
Aug 26 12:20:13 user nova-compute[73068]: DEBUG nova.objects.instance [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lazy-loading 'resources' on Instance uuid efcec8a5-ee86-4792-8fe9-5895904d87e9 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:15:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-520306355',display_name='tempest-TestVolumeBootPattern-server-520306355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-520306355',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGGbDW4IRPfWF2oDe7BnqRb6o5JLW4b+4VkEEmTq+OSUSPTsa+5KbFcPMJM3eoijlk/fK/7tW9d21OBnSGqw6nSrw3X4hF4egAzXJPAe2/Rr0+ZAV+DpkZLHfAspD9LzA==',key_name='tempest-TestVolumeBootPattern-888567676',keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:15:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='681694efee294a74b277fced3266643d',ramdisk_id='',reservation_id='r-7me80dbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-731970169',owner_user_name='tempest-TestVolumeBootPattern-731970169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:15:24Z,user_data=None,user_id='1c7914d369aa429394c647f73846fe5a',uuid=efcec8a5-ee86-4792-8fe9-5895904d87e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converting VIF {"id": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "address": "fa:16:3e:ac:ca:e4", "network": {"id": "c134a8fd-5e0d-4fe1-84ca-e985e182d880", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2002378377-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "681694efee294a74b277fced3266643d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a846e4f-70", "ovs_interfaceid": "8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a846e4f-70') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_vif [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a846e4f-70') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a846e4f-70, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:20:13 user nova-compute[73068]: INFO os_vif [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ca:e4,bridge_name='br-int',has_traffic_filtering=True,id=8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc,network=Network(c134a8fd-5e0d-4fe1-84ca-e985e182d880),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a846e4f-70')
Aug 26 12:20:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BKevuPEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:20:13 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3ee080-94d1-4847-a77b-c1778b84c784]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba9f140-46ed-48c8-8fa2-4402df8d18bd]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:20:13 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb (non-flash)
Aug 26 12:20:13 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb034a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54e42da-4f89-4f32-a62c-9c36accc583b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a207536-448f-48fd-8f1a-90ad959d1711]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24f2eea-c1a8-4699-91e0-85ef8a751630]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4287b076-1bd9-4cbe-9c78-58099ffd0c8a]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23737626430616534', '/dev/disk/by-id/scsi-1SCST_BIOed0cf5fe-77bd0ae4ad0c5f08', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ed0cf5fe') {{(pid=83861) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[762776f2-87f8-412e-8b00-52301ab033c0]: (4, None) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c776b13e-689b-4cfe-924f-93b0a75f7e7a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef4433-d612-4ccb-98a1-993fc5f668e3]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260]
Aug 26 12:20:13 user nova-compute[73068]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb, portal: 172.16.0.220,3260] successful.
Aug 26 12:20:13 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37af08cb-6dcd-4861-bcbc-01b883ce82eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b322c6b5-09d2-47e5-b482-f78cfd4aa941]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] <== disconnect_volume: return (308ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:20:13 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Deleting instance files /opt/stack/data/nova/instances/efcec8a5-ee86-4792-8fe9-5895904d87e9_del
Aug 26 12:20:13 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Deletion of /opt/stack/data/nova/instances/efcec8a5-ee86-4792-8fe9-5895904d87e9_del complete
Aug 26 12:20:13 user nova-compute[73068]: INFO nova.compute.manager [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 26 12:20:13 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:20:14 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Took 0.55 seconds to deallocate network for instance.
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-a1bac2a1-f6b6-4b5e-a02b-5cfedfd9a071 req-bdf4d926-9eb5-4241-ae0e-72cc88dc532f service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-vif-deleted-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Acquiring lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] No waiting events found dispatching network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:14 user nova-compute[73068]: WARNING nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received unexpected event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc for instance with vm_state active and task_state deleting.
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Acquiring lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] No waiting events found dispatching network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:14 user nova-compute[73068]: WARNING nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received unexpected event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc for instance with vm_state active and task_state deleting.
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Acquiring lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] No waiting events found dispatching network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:14 user nova-compute[73068]: WARNING nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received unexpected event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc for instance with vm_state active and task_state deleting.
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-vif-unplugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Acquiring lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] No waiting events found dispatching network-vif-unplugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-vif-unplugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Acquiring lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] No waiting events found dispatching network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:15 user nova-compute[73068]: WARNING nova.compute.manager [req-c0209be9-e0a5-4187-aed9-f3cb4d7f9cf0 req-2f58995e-93fc-4c54-8ad6-ae49eaf08c86 service nova] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Received unexpected event network-vif-plugged-8a846e4f-70f2-4e8d-ba0e-cf51535e2cbc for instance with vm_state active and task_state deleting.
Aug 26 12:20:15 user nova-compute[73068]: INFO nova.compute.manager [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Took 0.82 seconds to detach 1 volumes for instance.
Aug 26 12:20:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:15 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:20:15 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:20:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:15 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Deleted allocations for instance efcec8a5-ee86-4792-8fe9-5895904d87e9
Aug 26 12:20:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-a9af4658-7187-4237-857d-03503b7f5825 tempest-TestVolumeBootPattern-731970169 tempest-TestVolumeBootPattern-731970169-project-member] Lock "efcec8a5-ee86-4792-8fe9-5895904d87e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.884s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:20:19 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:20:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:19 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:20:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:20:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:20:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:20:19 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:20:20 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:20:20 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:20:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8741MB free_disk=25.225677490234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:20:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:20:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:20:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:20:20 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:20:20 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:20:20 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:20:20 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:21 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:20:21 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:22 user nova-compute[73068]: INFO nova.compute.manager [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Terminating instance
Aug 26 12:20:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-05596231-a850-4bcf-b4a9-9a937af072e5 req-13b8e097-a13c-401b-be3d-c858427c59e3 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-05596231-a850-4bcf-b4a9-9a937af072e5 req-13b8e097-a13c-401b-be3d-c858427c59e3 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-05596231-a850-4bcf-b4a9-9a937af072e5 req-13b8e097-a13c-401b-be3d-c858427c59e3 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-05596231-a850-4bcf-b4a9-9a937af072e5 req-13b8e097-a13c-401b-be3d-c858427c59e3 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-05596231-a850-4bcf-b4a9-9a937af072e5 req-13b8e097-a13c-401b-be3d-c858427c59e3 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:22 user nova-compute[73068]: DEBUG nova.compute.manager [req-05596231-a850-4bcf-b4a9-9a937af072e5 req-13b8e097-a13c-401b-be3d-c858427c59e3 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:23 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Instance destroyed successfully.
Aug 26 12:20:23 user nova-compute[73068]: DEBUG nova.objects.instance [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lazy-loading 'resources' on Instance uuid 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:03:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-644189681',display_name='tempest-ServerRescueNegativeTestJSON-server-644189681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-644189681',id=42,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:08:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89262659b6e249969ee0edb7cd482d1f',ramdisk_id='',reservation_id='r-pykyh5j0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-982037839',owner_user_name='tempest-ServerRescueNegativeTestJSON-982037839-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:09:55Z,user_data=None,user_id='39a8587c93764774ac04c74f11ed6498',uuid=4e21d114-7d6c-4a4a-ab2e-51e7d169fc81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converting VIF {"id": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "address": "fa:16:3e:55:54:54", "network": {"id": "a7d1624c-48e9-4c21-adab-787eafd9a405", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-991761589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89262659b6e249969ee0edb7cd482d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf8b5dfa-bb", "ovs_interfaceid": "df8b5dfa-bb92-47f7-bb60-cb6aee769aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:54:54,bridge_name='br-int',has_traffic_filtering=True,id=df8b5dfa-bb92-47f7-bb60-cb6aee769aa8,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8b5dfa-bb') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG os_vif [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:54:54,bridge_name='br-int',has_traffic_filtering=True,id=df8b5dfa-bb92-47f7-bb60-cb6aee769aa8,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8b5dfa-bb') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf8b5dfa-bb, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:20:23 user nova-compute[73068]: INFO os_vif [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:54:54,bridge_name='br-int',has_traffic_filtering=True,id=df8b5dfa-bb92-47f7-bb60-cb6aee769aa8,network=Network(a7d1624c-48e9-4c21-adab-787eafd9a405),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf8b5dfa-bb')
Aug 26 12:20:23 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Deleting instance files /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81_del
Aug 26 12:20:23 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Deletion of /opt/stack/data/nova/instances/4e21d114-7d6c-4a4a-ab2e-51e7d169fc81_del complete
Aug 26 12:20:23 user nova-compute[73068]: INFO nova.compute.manager [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 26 12:20:23 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:20:24 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Took 0.97 seconds to deallocate network for instance.
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-b9291194-75d5-4cd0-a246-1ac4048ff3c2 req-9a086276-85d2-4ad9-93b7-244942588116 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-deleted-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:24 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Deleted allocations for instance 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-837d2aa0-a639-4d5b-9468-ed9e973b191a tempest-ServerRescueNegativeTestJSON-982037839 tempest-ServerRescueNegativeTestJSON-982037839-project-member] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.105s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:24 user nova-compute[73068]: WARNING nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state deleted and task_state None.
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:24 user nova-compute[73068]: WARNING nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state deleted and task_state None.
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:24 user nova-compute[73068]: WARNING nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state deleted and task_state None.
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:24 user nova-compute[73068]: WARNING nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-unplugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state deleted and task_state None.
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Acquiring lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] Lock "4e21d114-7d6c-4a4a-ab2e-51e7d169fc81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:20:24 user nova-compute[73068]: DEBUG nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] No waiting events found dispatching network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:20:24 user nova-compute[73068]: WARNING nova.compute.manager [req-c98510c3-8421-4a28-8000-76a26a0c36a7 req-f52583b0-9c53-44dc-9566-27a49ddb1782 service nova] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Received unexpected event network-vif-plugged-df8b5dfa-bb92-47f7-bb60-cb6aee769aa8 for instance with vm_state deleted and task_state None.
Aug 26 12:20:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:20:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:28 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693052413.3599303, efcec8a5-ee86-4792-8fe9-5895904d87e9 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:20:28 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] VM Stopped (Lifecycle Event)
Aug 26 12:20:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-aa3e1fd4-745c-4a9c-97f5-619acf2f3910 None None] [instance: efcec8a5-ee86-4792-8fe9-5895904d87e9] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:20:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:20:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:20:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:20:28 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 12:20:29 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:20:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:20:38 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693052423.1498108, 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:20:38 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] VM Stopped (Lifecycle Event)
Aug 26 12:20:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-f2c245da-3c0c-4395-8c4a-3fcb25b840cb None None] [instance: 4e21d114-7d6c-4a4a-ab2e-51e7d169fc81] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:20:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:20:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:20:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:20:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:20:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:20:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:20:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:20:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:20:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:20:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:20:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:20:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:20:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:20:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:20:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:20:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:21:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:21:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:21:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:21:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:21:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:20 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:21:20 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:21:21 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:21:21 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:21:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:21:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:21:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:21:21 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:21:21 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:21:21 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:21:21 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=25.25200653076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:21:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:21:21 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:21:21 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:21:21 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:21:21 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:21:22 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:21:22 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:21:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:21:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:21:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:21:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:21:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:21:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:21:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:21:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:21:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:21:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:21:30 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:21:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:21:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:21:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 12:21:31 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:21:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:21:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:21:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:21:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:21:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:21:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:21:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:21:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:21:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:22:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:22:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:22:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:22:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:22:22 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:22:22 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:22:22 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=9000MB free_disk=25.25027847290039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:22:22 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:22:23 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:22:23 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:22:23 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.125s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:22:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:22:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:22:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:22:25 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:22:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:22:27 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:22:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:22:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:22:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:22:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:22:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 12:22:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:22:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:22:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:22:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:22:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:22:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:22:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:22:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:22:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:22:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:22:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:22:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:23:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:14 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:23:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:23 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:23:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:23:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:23:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:23:24 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:23:24 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:23:24 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:23:24 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=25.248790740966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:23:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:23:24 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:23:25 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:23:25 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:23:25 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 12:23:25 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 12:23:25 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 12:23:25 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 12:23:25 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 12:23:25 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:23:25 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:23:25 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:23:25 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:23:26 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:34 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:23:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:23:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 12:23:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "76b859e4-1832-434a-afba-caa8d5b1fb87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:23:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:23:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:23:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:23:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:23:37 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:23:37 user nova-compute[73068]: INFO nova.compute.claims [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Claim successful on node user
Aug 26 12:23:38 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.179s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:23:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:23:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:23:38 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Creating image(s)
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "/opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "/opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "/opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG nova.policy [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34a4a9c504754a948f11c9d41b773c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b030a49f6a34fd88e09129a06a45101', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.181s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk 1073741824" returned: 0 in 0.144s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:23:38 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.172s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Successfully created port: 09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Cannot resize image /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Ensure instance console log exists: /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Successfully updated port: 09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquired lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-35007846-6eee-437a-af0d-675aca71eef1 req-be4dad3f-cbfd-44ee-8342-44a645407d57 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Received event network-changed-09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG nova.compute.manager [req-35007846-6eee-437a-af0d-675aca71eef1 req-be4dad3f-cbfd-44ee-8342-44a645407d57 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Refreshing instance network info cache due to event network-changed-09eecaee-3594-451a-9529-a0b7488f909d. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-35007846-6eee-437a-af0d-675aca71eef1 req-be4dad3f-cbfd-44ee-8342-44a645407d57 service nova] Acquiring lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:23:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updating instance_info_cache with network_info: [{"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Releasing lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Instance network_info: |[{"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-35007846-6eee-437a-af0d-675aca71eef1 req-be4dad3f-cbfd-44ee-8342-44a645407d57 service nova] Acquired lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.network.neutron [req-35007846-6eee-437a-af0d-675aca71eef1 req-be4dad3f-cbfd-44ee-8342-44a645407d57 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Refreshing network info cache for port 09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Start _get_guest_xml network_info=[{"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:23:40 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:23:40 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1065944870',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1065944870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1065944',id=51,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9RjfWETOG6w5UHZOKEoGbiI6xFAupw0MIdIRrrnC59pUa+eLPxP9mj9zJnmnAnFNRUTf6hrQHffQHV6/vqlSHLtscnYJcPJlAacvTmf9bcoPmRGAG+ixZPfi+oxQ0OBA==',key_name='tempest-keypair-1815084162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b030a49f6a34fd88e09129a06a45101',ramdisk_id='',reservation_id='r-ddahls9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2069057041',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:23:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a4a9c504754a948f11c9d41b773c96',uuid=76b859e4-1832-434a-afba-caa8d5b1fb87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Converting VIF {"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4b:92,bridge_name='br-int',has_traffic_filtering=True,id=09eecaee-3594-451a-9529-a0b7488f909d,network=Network(9397bd5d-97ef-496d-90e5-b7d40f6a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09eecaee-35') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.objects.instance [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lazy-loading 'pci_devices' on Instance uuid 76b859e4-1832-434a-afba-caa8d5b1fb87 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:23:40 user nova-compute[73068]:   <uuid>76b859e4-1832-434a-afba-caa8d5b1fb87</uuid>
Aug 26 12:23:40 user nova-compute[73068]:   <name>instance-00000033</name>
Aug 26 12:23:40 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:23:40 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:23:40 user nova-compute[73068]:   <metadata>
Aug 26 12:23:40 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:23:40 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:23:40 user nova-compute[73068]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1065944870</nova:name>
Aug 26 12:23:40 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:23:40</nova:creationTime>
Aug 26 12:23:40 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:23:40 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:23:40 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:23:40 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:23:40 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:23:40 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:23:40 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:23:40 user nova-compute[73068]:       <nova:owner>
Aug 26 12:23:40 user nova-compute[73068]:         <nova:user uuid="34a4a9c504754a948f11c9d41b773c96">tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member</nova:user>
Aug 26 12:23:40 user nova-compute[73068]:         <nova:project uuid="3b030a49f6a34fd88e09129a06a45101">tempest-TestServerVolumeAttachScenarioOldVersion-2069057041</nova:project>
Aug 26 12:23:40 user nova-compute[73068]:       </nova:owner>
Aug 26 12:23:40 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 12:23:40 user nova-compute[73068]:       <nova:ports>
Aug 26 12:23:40 user nova-compute[73068]:         <nova:port uuid="09eecaee-3594-451a-9529-a0b7488f909d">
Aug 26 12:23:40 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 12:23:40 user nova-compute[73068]:         </nova:port>
Aug 26 12:23:40 user nova-compute[73068]:       </nova:ports>
Aug 26 12:23:40 user nova-compute[73068]:     </nova:instance>
Aug 26 12:23:40 user nova-compute[73068]:   </metadata>
Aug 26 12:23:40 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:23:40 user nova-compute[73068]:     <system>
Aug 26 12:23:40 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:23:40 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:23:40 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:23:40 user nova-compute[73068]:       <entry name="serial">76b859e4-1832-434a-afba-caa8d5b1fb87</entry>
Aug 26 12:23:40 user nova-compute[73068]:       <entry name="uuid">76b859e4-1832-434a-afba-caa8d5b1fb87</entry>
Aug 26 12:23:40 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:23:40 user nova-compute[73068]:     </system>
Aug 26 12:23:40 user nova-compute[73068]:   </sysinfo>
Aug 26 12:23:40 user nova-compute[73068]:   <os>
Aug 26 12:23:40 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:23:40 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:23:40 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:23:40 user nova-compute[73068]:   </os>
Aug 26 12:23:40 user nova-compute[73068]:   <features>
Aug 26 12:23:40 user nova-compute[73068]:     <acpi/>
Aug 26 12:23:40 user nova-compute[73068]:     <apic/>
Aug 26 12:23:40 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:23:40 user nova-compute[73068]:   </features>
Aug 26 12:23:40 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:23:40 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:23:40 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:23:40 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:23:40 user nova-compute[73068]:   </clock>
Aug 26 12:23:40 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:23:40 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:23:40 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:23:40 user nova-compute[73068]:   </cpu>
Aug 26 12:23:40 user nova-compute[73068]:   <devices>
Aug 26 12:23:40 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:23:40 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:23:40 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk"/>
Aug 26 12:23:40 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:23:40 user nova-compute[73068]:     </disk>
Aug 26 12:23:40 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:23:40 user nova-compute[73068]:       <mac address="fa:16:3e:5d:4b:92"/>
Aug 26 12:23:40 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:23:40 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:23:40 user nova-compute[73068]:       <target dev="tap09eecaee-35"/>
Aug 26 12:23:40 user nova-compute[73068]:     </interface>
Aug 26 12:23:40 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:23:40 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/console.log" append="off"/>
Aug 26 12:23:40 user nova-compute[73068]:     </serial>
Aug 26 12:23:40 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:23:40 user nova-compute[73068]:     <video>
Aug 26 12:23:40 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:23:40 user nova-compute[73068]:     </video>
Aug 26 12:23:40 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:23:40 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:23:40 user nova-compute[73068]:     </rng>
Aug 26 12:23:40 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:23:40 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:23:40 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:23:40 user nova-compute[73068]:     </memballoon>
Aug 26 12:23:40 user nova-compute[73068]:   </devices>
Aug 26 12:23:40 user nova-compute[73068]: </domain>
Aug 26 12:23:40 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1065944870',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1065944870',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1065944',id=51,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9RjfWETOG6w5UHZOKEoGbiI6xFAupw0MIdIRrrnC59pUa+eLPxP9mj9zJnmnAnFNRUTf6hrQHffQHV6/vqlSHLtscnYJcPJlAacvTmf9bcoPmRGAG+ixZPfi+oxQ0OBA==',key_name='tempest-keypair-1815084162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b030a49f6a34fd88e09129a06a45101',ramdisk_id='',reservation_id='r-ddahls9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2069057041',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:23:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a4a9c504754a948f11c9d41b773c96',uuid=76b859e4-1832-434a-afba-caa8d5b1fb87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Converting VIF {"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4b:92,bridge_name='br-int',has_traffic_filtering=True,id=09eecaee-3594-451a-9529-a0b7488f909d,network=Network(9397bd5d-97ef-496d-90e5-b7d40f6a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09eecaee-35') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG os_vif [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4b:92,bridge_name='br-int',has_traffic_filtering=True,id=09eecaee-3594-451a-9529-a0b7488f909d,network=Network(9397bd5d-97ef-496d-90e5-b7d40f6a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09eecaee-35') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09eecaee-35, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09eecaee-35, col_values=(('external_ids', {'iface-id': '09eecaee-3594-451a-9529-a0b7488f909d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:4b:92', 'vm-uuid': '76b859e4-1832-434a-afba-caa8d5b1fb87'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:40 user nova-compute[73068]: INFO os_vif [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:4b:92,bridge_name='br-int',has_traffic_filtering=True,id=09eecaee-3594-451a-9529-a0b7488f909d,network=Network(9397bd5d-97ef-496d-90e5-b7d40f6a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09eecaee-35')
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] No VIF found with MAC fa:16:3e:5d:4b:92, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.network.neutron [req-35007846-6eee-437a-af0d-675aca71eef1 req-be4dad3f-cbfd-44ee-8342-44a645407d57 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updated VIF entry in instance network info cache for port 09eecaee-3594-451a-9529-a0b7488f909d. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG nova.network.neutron [req-35007846-6eee-437a-af0d-675aca71eef1 req-be4dad3f-cbfd-44ee-8342-44a645407d57 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updating instance_info_cache with network_info: [{"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:23:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-35007846-6eee-437a-af0d-675aca71eef1 req-be4dad3f-cbfd-44ee-8342-44a645407d57 service nova] Releasing lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:23:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-37b2ed12-5d53-47b4-97d0-968cd9d518fb req-99418045-523c-4791-b7ac-e304d0597560 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Received event network-vif-plugged-09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:23:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-37b2ed12-5d53-47b4-97d0-968cd9d518fb req-99418045-523c-4791-b7ac-e304d0597560 service nova] Acquiring lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:23:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-37b2ed12-5d53-47b4-97d0-968cd9d518fb req-99418045-523c-4791-b7ac-e304d0597560 service nova] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:23:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-37b2ed12-5d53-47b4-97d0-968cd9d518fb req-99418045-523c-4791-b7ac-e304d0597560 service nova] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:23:41 user nova-compute[73068]: DEBUG nova.compute.manager [req-37b2ed12-5d53-47b4-97d0-968cd9d518fb req-99418045-523c-4791-b7ac-e304d0597560 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] No waiting events found dispatching network-vif-plugged-09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:23:41 user nova-compute[73068]: WARNING nova.compute.manager [req-37b2ed12-5d53-47b4-97d0-968cd9d518fb req-99418045-523c-4791-b7ac-e304d0597560 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Received unexpected event network-vif-plugged-09eecaee-3594-451a-9529-a0b7488f909d for instance with vm_state building and task_state spawning.
Aug 26 12:23:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052623.7578905, 76b859e4-1832-434a-afba-caa8d5b1fb87 => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:23:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] VM Resumed (Lifecycle Event)
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:23:43 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Instance spawned successfully.
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:23:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052623.7594657, 76b859e4-1832-434a-afba-caa8d5b1fb87 => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:23:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] VM Started (Lifecycle Event)
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:23:43 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:23:43 user nova-compute[73068]: INFO nova.compute.manager [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Took 5.49 seconds to spawn the instance on the hypervisor.
Aug 26 12:23:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:23:43 user nova-compute[73068]: INFO nova.compute.manager [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Took 5.99 seconds to build instance.
Aug 26 12:23:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-529958cb-267e-4c41-be25-4266cf87f7b8 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.077s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:23:44 user nova-compute[73068]: DEBUG nova.compute.manager [req-80ee06b7-9d88-486a-b2ab-dfa18c223009 req-7bf9f7b4-9d3b-462b-873d-312008af684f service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Received event network-vif-plugged-09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:23:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-80ee06b7-9d88-486a-b2ab-dfa18c223009 req-7bf9f7b4-9d3b-462b-873d-312008af684f service nova] Acquiring lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:23:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-80ee06b7-9d88-486a-b2ab-dfa18c223009 req-7bf9f7b4-9d3b-462b-873d-312008af684f service nova] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:23:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-80ee06b7-9d88-486a-b2ab-dfa18c223009 req-7bf9f7b4-9d3b-462b-873d-312008af684f service nova] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:23:44 user nova-compute[73068]: DEBUG nova.compute.manager [req-80ee06b7-9d88-486a-b2ab-dfa18c223009 req-7bf9f7b4-9d3b-462b-873d-312008af684f service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] No waiting events found dispatching network-vif-plugged-09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:23:44 user nova-compute[73068]: WARNING nova.compute.manager [req-80ee06b7-9d88-486a-b2ab-dfa18c223009 req-7bf9f7b4-9d3b-462b-873d-312008af684f service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Received unexpected event network-vif-plugged-09eecaee-3594-451a-9529-a0b7488f909d for instance with vm_state active and task_state None.
Aug 26 12:23:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:47 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:49 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 12:23:49 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 12:23:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:23:52 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:23:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:04 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:24:04 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 12:24:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:23 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:24:23 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:24:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:24:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:24:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:24:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:24:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:25 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:24:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:24:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:24:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:24:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:24:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:24:26 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:24:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:24:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:24:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:24:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:24:27 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:24:27 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:24:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8822MB free_disk=25.218486785888672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:24:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:24:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:24:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 76b859e4-1832-434a-afba-caa8d5b1fb87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:24:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:24:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:24:27 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:24:27 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:24:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:24:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:24:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:24:29 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:24:29 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:24:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:24:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:35 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:24:35 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:24:35 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:24:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:24:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:24:35 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:24:35 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 76b859e4-1832-434a-afba-caa8d5b1fb87 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:24:36 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updating instance_info_cache with network_info: [{"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:24:36 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:24:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:24:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:24:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:24:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:24:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:25:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:25:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:25:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:25:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:25:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:25:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:25:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:25:26 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:25:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:27 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:25:27 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:25:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8829MB free_disk=25.217933654785156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:25:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:25:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:25:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 76b859e4-1832-434a-afba-caa8d5b1fb87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:25:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:25:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:25:27 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:25:27 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:25:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:25:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:25:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:25:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:25:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-f3d02f69-01ee-4131-bc2d-4683865ddd29 req-11db85a6-1380-445f-979b-28f7df2eae98 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Received event network-changed-09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:25:29 user nova-compute[73068]: DEBUG nova.compute.manager [req-f3d02f69-01ee-4131-bc2d-4683865ddd29 req-11db85a6-1380-445f-979b-28f7df2eae98 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Refreshing instance network info cache due to event network-changed-09eecaee-3594-451a-9529-a0b7488f909d. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:25:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f3d02f69-01ee-4131-bc2d-4683865ddd29 req-11db85a6-1380-445f-979b-28f7df2eae98 service nova] Acquiring lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:25:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f3d02f69-01ee-4131-bc2d-4683865ddd29 req-11db85a6-1380-445f-979b-28f7df2eae98 service nova] Acquired lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:25:29 user nova-compute[73068]: DEBUG nova.network.neutron [req-f3d02f69-01ee-4131-bc2d-4683865ddd29 req-11db85a6-1380-445f-979b-28f7df2eae98 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Refreshing network info cache for port 09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:25:29 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:25:29 user nova-compute[73068]: DEBUG nova.network.neutron [req-f3d02f69-01ee-4131-bc2d-4683865ddd29 req-11db85a6-1380-445f-979b-28f7df2eae98 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updated VIF entry in instance network info cache for port 09eecaee-3594-451a-9529-a0b7488f909d. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:25:29 user nova-compute[73068]: DEBUG nova.network.neutron [req-f3d02f69-01ee-4131-bc2d-4683865ddd29 req-11db85a6-1380-445f-979b-28f7df2eae98 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updating instance_info_cache with network_info: [{"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:25:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f3d02f69-01ee-4131-bc2d-4683865ddd29 req-11db85a6-1380-445f-979b-28f7df2eae98 service nova] Releasing lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:25:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:31 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:25:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "76b859e4-1832-434a-afba-caa8d5b1fb87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG nova.objects.instance [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lazy-loading 'flavor' on Instance uuid 76b859e4-1832-434a-afba-caa8d5b1fb87 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "76b859e4-1832-434a-afba-caa8d5b1fb87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:25:34 user nova-compute[73068]: INFO nova.compute.manager [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Attaching volume 12905746-e69b-4a02-8e3f-77c83cf5c5a4 to /dev/vdb
Aug 26 12:25:34 user nova-compute[73068]: DEBUG os_brick.utils [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[55529038-c98a-4b9e-a8f9-4297666749ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe377d8e-f00b-487a-ac2e-77ef25061d7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b28cdd-17fa-42a3-b7eb-b36e7396f988]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbb005e-4463-4543-8956-f8f92f62f635]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:25:34 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:35 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:25:35 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:25:35 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37cdbe0-3a28-49d6-a1fb-6089e381ad63]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:25:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:25:35 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:25:35 user nova-compute[73068]: DEBUG os_brick.utils [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:25:35 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updating existing volume attachment record: 84029f30-7915-4d10-b747-e1a358b7f0e8 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:25:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:36 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:25:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:37 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:25:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:25:37 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:25:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:25:37 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:25:37 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:25:37 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 76b859e4-1832-434a-afba-caa8d5b1fb87 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:25:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updating instance_info_cache with network_info: [{"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:25:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:25:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:25:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJapBoSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:25:52 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:25:52 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:25:52 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76547f00-3e9e-4912-a2a5-d20d7db3c5ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:25:52 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3313a7-d97c-4671-baec-f0d1cec67931]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4] added
Aug 26 12:25:52 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1248fb07-d4b1-4c56-b475-4e85c599247c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3829b05-8439-4637-8567-ebe3c87cf101]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wJapBoSL {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wJapBoSL" returned: 0 in 0.024s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9f8c0c-348c-4a30-9cf3-7caab944c402]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wJapBoSL'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[70da671b-6ce4-491a-8399-94a418a1b0bc]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a01e22-26b6-4e8e-9efd-df31e16d98dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:25:52 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:25:52 user nova-compute[73068]:  {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:25:52 user nova-compute[73068]: WARNING os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 12:25:52 user nova-compute[73068]: 
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b144f28-b36c-478c-848b-7ffadd447ee6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4, portal: 172.16.0.220,3260]
Aug 26 12:25:52 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4, portal: 172.16.0.220,3260] successful.
Aug 26 12:25:52 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c7c003-33af-4ad7-95d7-101e4185c576]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd32d3cd-0b2f-4bc1-88db-fd77d051034c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 (non-flash)
Aug 26 12:25:52 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 (non-flash)
Aug 26 12:25:52 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b981d04-0712-49ec-8ed1-f652214c03d8]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:25:52 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJapBoSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:25:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:25:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26633623634363235', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:25:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633623634363235', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:25:53 user nova-compute[73068]: DEBUG nova.objects.instance [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lazy-loading 'flavor' on Instance uuid 76b859e4-1832-434a-afba-caa8d5b1fb87 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:25:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 12:25:53 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:25:53 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:25:53 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:25:53 user nova-compute[73068]:   <serial>12905746-e69b-4a02-8e3f-77c83cf5c5a4</serial>
Aug 26 12:25:53 user nova-compute[73068]: </disk>
Aug 26 12:25:53 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 12:25:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:25:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:25:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] No VIF found with MAC fa:16:3e:5d:4b:92, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:25:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-f351fb02-ea2d-47d6-8300-04b040de4464 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.333s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:25:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "76b859e4-1832-434a-afba-caa8d5b1fb87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:25:56 user nova-compute[73068]: INFO nova.compute.manager [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Detaching volume 12905746-e69b-4a02-8e3f-77c83cf5c5a4
Aug 26 12:25:56 user nova-compute[73068]: INFO nova.virt.block_device [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Attempting to driver detach volume 12905746-e69b-4a02-8e3f-77c83cf5c5a4 from mountpoint /dev/vdb
Aug 26 12:25:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Attempting to detach device vdb from instance 76b859e4-1832-434a-afba-caa8d5b1fb87 from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:25:56 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:25:56 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:25:56 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:25:56 user nova-compute[73068]:   <serial>12905746-e69b-4a02-8e3f-77c83cf5c5a4</serial>
Aug 26 12:25:56 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:25:56 user nova-compute[73068]: </disk>
Aug 26 12:25:56 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:25:56 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Successfully detached device vdb from instance 76b859e4-1832-434a-afba-caa8d5b1fb87 from the persistent domain config.
Aug 26 12:25:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76b859e4-1832-434a-afba-caa8d5b1fb87 from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:25:56 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:25:56 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:25:56 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:25:56 user nova-compute[73068]:   <serial>12905746-e69b-4a02-8e3f-77c83cf5c5a4</serial>
Aug 26 12:25:56 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:25:56 user nova-compute[73068]: </disk>
Aug 26 12:25:56 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693052756.6760614, 76b859e4-1832-434a-afba-caa8d5b1fb87 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76b859e4-1832-434a-afba-caa8d5b1fb87 {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 12:25:56 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Successfully detached device vdb from instance 76b859e4-1832-434a-afba-caa8d5b1fb87 from the live domain config.
Aug 26 12:25:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJapBoSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:25:56 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d65e75c-eae5-4c40-9485-a03b81eb67dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c3a531-0712-4b77-8c2b-0906dcc48861]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 (non-flash)
Aug 26 12:25:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 (non-flash)
Aug 26 12:25:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddb0348550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c97e77-368d-4077-90bf-56bb30e3438e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d26ef41-aa43-4070-b267-04477ef5c667]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0050c967-26a5-41e8-938e-7ade33967150]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f167e12e-bfdf-4052-86da-6d5875dbb30b]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e0922d-d87d-4db7-9b7d-9ed85870b7d9]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e203bd7-0161-4e25-b06e-de6843cd5576]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4, portal: 172.16.0.220,3260]
Aug 26 12:25:56 user nova-compute[73068]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4, portal: 172.16.0.220,3260] successful.
Aug 26 12:25:56 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12905746-e69b-4a02-8e3f-77c83cf5c5a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d92569-fe47-4e15-ae34-fd76ace36e0c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.246s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] <== disconnect_volume: return (247ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:25:56 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:25:57 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:25:57 user nova-compute[73068]: DEBUG nova.objects.instance [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lazy-loading 'flavor' on Instance uuid 76b859e4-1832-434a-afba-caa8d5b1fb87 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:25:57 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-9e1060db-acf8-41aa-824e-0d16adbc1beb tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.577s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:26:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:24 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:26:24 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:26:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:26:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:26:26 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:26:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:26:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:26:26 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.004s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:26:26 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:26:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:26:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:26:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:26:26 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:26:27 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:26:27 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:26:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.21668243408203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:26:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:26:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:26:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 76b859e4-1832-434a-afba-caa8d5b1fb87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:26:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:26:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:26:27 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:26:27 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:26:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:26:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:26:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:30 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:26:30 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:26:31 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:26:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:26:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:37 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:26:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:26:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:26:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:26:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:26:38 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:26:38 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:26:38 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 76b859e4-1832-434a-afba-caa8d5b1fb87 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:26:39 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updating instance_info_cache with network_info: [{"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:26:39 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-76b859e4-1832-434a-afba-caa8d5b1fb87" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:26:39 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:26:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "76b859e4-1832-434a-afba-caa8d5b1fb87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:26:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:26:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:26:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:26:52 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:26:52 user nova-compute[73068]: INFO nova.compute.manager [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Terminating instance
Aug 26 12:26:52 user nova-compute[73068]: DEBUG nova.compute.manager [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-f65632ca-5177-4a40-86f3-823b9556d690 req-a93bee52-b122-44f4-ab47-f9cebadaa62b service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Received event network-vif-unplugged-09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f65632ca-5177-4a40-86f3-823b9556d690 req-a93bee52-b122-44f4-ab47-f9cebadaa62b service nova] Acquiring lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f65632ca-5177-4a40-86f3-823b9556d690 req-a93bee52-b122-44f4-ab47-f9cebadaa62b service nova] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-f65632ca-5177-4a40-86f3-823b9556d690 req-a93bee52-b122-44f4-ab47-f9cebadaa62b service nova] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-f65632ca-5177-4a40-86f3-823b9556d690 req-a93bee52-b122-44f4-ab47-f9cebadaa62b service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] No waiting events found dispatching network-vif-unplugged-09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG nova.compute.manager [req-f65632ca-5177-4a40-86f3-823b9556d690 req-a93bee52-b122-44f4-ab47-f9cebadaa62b service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Received event network-vif-unplugged-09eecaee-3594-451a-9529-a0b7488f909d for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:53 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Instance destroyed successfully.
Aug 26 12:26:53 user nova-compute[73068]: DEBUG nova.objects.instance [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lazy-loading 'resources' on Instance uuid 76b859e4-1832-434a-afba-caa8d5b1fb87 {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1065944870',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1065944870',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1065944',id=51,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9RjfWETOG6w5UHZOKEoGbiI6xFAupw0MIdIRrrnC59pUa+eLPxP9mj9zJnmnAnFNRUTf6hrQHffQHV6/vqlSHLtscnYJcPJlAacvTmf9bcoPmRGAG+ixZPfi+oxQ0OBA==',key_name='tempest-keypair-1815084162',keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b030a49f6a34fd88e09129a06a45101',ramdisk_id='',reservation_id='r-ddahls9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2069057041',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34a4a9c504754a948f11c9d41b773c96',uuid=76b859e4-1832-434a-afba-caa8d5b1fb87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Converting VIF {"id": "09eecaee-3594-451a-9529-a0b7488f909d", "address": "fa:16:3e:5d:4b:92", "network": {"id": "9397bd5d-97ef-496d-90e5-b7d40f6a216e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2076717863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b030a49f6a34fd88e09129a06a45101", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09eecaee-35", "ovs_interfaceid": "09eecaee-3594-451a-9529-a0b7488f909d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:4b:92,bridge_name='br-int',has_traffic_filtering=True,id=09eecaee-3594-451a-9529-a0b7488f909d,network=Network(9397bd5d-97ef-496d-90e5-b7d40f6a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09eecaee-35') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG os_vif [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:4b:92,bridge_name='br-int',has_traffic_filtering=True,id=09eecaee-3594-451a-9529-a0b7488f909d,network=Network(9397bd5d-97ef-496d-90e5-b7d40f6a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09eecaee-35') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09eecaee-35, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:26:53 user nova-compute[73068]: INFO os_vif [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:4b:92,bridge_name='br-int',has_traffic_filtering=True,id=09eecaee-3594-451a-9529-a0b7488f909d,network=Network(9397bd5d-97ef-496d-90e5-b7d40f6a216e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09eecaee-35')
Aug 26 12:26:53 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Deleting instance files /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87_del
Aug 26 12:26:53 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Deletion of /opt/stack/data/nova/instances/76b859e4-1832-434a-afba-caa8d5b1fb87_del complete
Aug 26 12:26:53 user nova-compute[73068]: INFO nova.compute.manager [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 12:26:53 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:26:53 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:26:54 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:26:54 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Took 0.95 seconds to deallocate network for instance.
Aug 26 12:26:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-dc99ae5f-d19c-4c3b-aa59-3d987daf8295 req-a2f080dc-51f8-42cd-8236-a456f6471928 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Received event network-vif-deleted-09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:26:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:26:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:26:54 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:26:55 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:26:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:26:55 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Deleted allocations for instance 76b859e4-1832-434a-afba-caa8d5b1fb87
Aug 26 12:26:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-65e10bbe-7245-4b4e-9e32-ebb4f3be5cf7 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041 tempest-TestServerVolumeAttachScenarioOldVersion-2069057041-project-member] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.183s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:26:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-5f9aeeaa-982d-4f2a-98be-35f1406ac22b req-c28b49ab-2e0c-4e7f-93a9-d679d9f61137 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Received event network-vif-plugged-09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:26:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5f9aeeaa-982d-4f2a-98be-35f1406ac22b req-c28b49ab-2e0c-4e7f-93a9-d679d9f61137 service nova] Acquiring lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:26:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5f9aeeaa-982d-4f2a-98be-35f1406ac22b req-c28b49ab-2e0c-4e7f-93a9-d679d9f61137 service nova] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:26:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-5f9aeeaa-982d-4f2a-98be-35f1406ac22b req-c28b49ab-2e0c-4e7f-93a9-d679d9f61137 service nova] Lock "76b859e4-1832-434a-afba-caa8d5b1fb87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:26:55 user nova-compute[73068]: DEBUG nova.compute.manager [req-5f9aeeaa-982d-4f2a-98be-35f1406ac22b req-c28b49ab-2e0c-4e7f-93a9-d679d9f61137 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] No waiting events found dispatching network-vif-plugged-09eecaee-3594-451a-9529-a0b7488f909d {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:26:55 user nova-compute[73068]: WARNING nova.compute.manager [req-5f9aeeaa-982d-4f2a-98be-35f1406ac22b req-c28b49ab-2e0c-4e7f-93a9-d679d9f61137 service nova] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Received unexpected event network-vif-plugged-09eecaee-3594-451a-9529-a0b7488f909d for instance with vm_state deleted and task_state None.
Aug 26 12:26:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:08 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693052813.7431235, 76b859e4-1832-434a-afba-caa8d5b1fb87 => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:27:08 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] VM Stopped (Lifecycle Event)
Aug 26 12:27:08 user nova-compute[73068]: DEBUG nova.compute.manager [None req-8f59b6be-d93b-4ae0-a7f4-4e0875955d59 None None] [instance: 76b859e4-1832-434a-afba-caa8d5b1fb87] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:27:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:27:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:27:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:27:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:27:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:27:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:27:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:27:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:27:18 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:23 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:25 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:27:25 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:27:27 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:27:27 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:27:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=25.243831634521484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:27:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:27:28 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:27:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:27:29 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:27:30 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:27:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:27:33 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:27:33 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:27:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:27:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:27:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:27:38 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 12:27:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:27:38 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:27:43 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:27:44 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:53 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:27:58 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:28:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:03 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:08 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:28:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:28:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Starting instance... {{(pid=73068) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 12:28:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:28:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:28:09 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73068) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 12:28:09 user nova-compute[73068]: INFO nova.compute.claims [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Claim successful on node user
Aug 26 12:28:09 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:28:09 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:28:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:28:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Start building networks asynchronously for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 12:28:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Allocating IP information in the background. {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 12:28:09 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] allocate_for_instance() {{(pid=73068) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 12:28:09 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 12:28:09 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Start building block device mappings for instance. {{(pid=73068) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG nova.policy [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d8101fb817b44e5bb66f883e1dddaf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0efeac9dfa314ac281ee27f33249297b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73068) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Start spawning the instance on the hypervisor. {{(pid=73068) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Creating instance directory {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 12:28:10 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Creating image(s)
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "/opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "/opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "/opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk 1073741824 {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98,backing_fmt=raw /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk 1073741824" returned: 0 in 0.051s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/494dc1f60f9cf5d1847ad270a5c6a89aaef3dd98 --force-share --output=json" returned: 0 in 0.180s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk. size=1073741824 {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Successfully created port: 215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG nova.virt.disk.api [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Cannot resize image /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk to a smaller size. {{(pid=73068) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Created local disks {{(pid=73068) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Ensure instance console log exists: /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/console.log {{(pid=73068) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:28:10 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Successfully updated port: 215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquired lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Building network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-c110b7ba-156f-49bd-bf77-7292ce61ca36 req-1b3f50c2-954f-418b-8b9e-071c640a0262 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Received event network-changed-215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.compute.manager [req-c110b7ba-156f-49bd-bf77-7292ce61ca36 req-1b3f50c2-954f-418b-8b9e-071c640a0262 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Refreshing instance network info cache due to event network-changed-215cca44-7d41-4717-b376-b3b9b1fe6da1. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c110b7ba-156f-49bd-bf77-7292ce61ca36 req-1b3f50c2-954f-418b-8b9e-071c640a0262 service nova] Acquiring lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Instance cache missing network info. {{(pid=73068) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.network.neutron [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Releasing lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Instance network_info: |[{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73068) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c110b7ba-156f-49bd-bf77-7292ce61ca36 req-1b3f50c2-954f-418b-8b9e-071c640a0262 service nova] Acquired lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.network.neutron [req-c110b7ba-156f-49bd-bf77-7292ce61ca36 req-1b3f50c2-954f-418b-8b9e-071c640a0262 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Refreshing network info cache for port 215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Start _get_guest_xml network_info=[{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'size': 0, 'encryption_format': None, 'device_name': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '7a04c5f4-de55-416c-8955-be802fd6bf8e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 12:28:11 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:28:11 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] CPU controller missing on host. {{(pid=73068) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.host [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] CPU controller found on host. {{(pid=73068) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73068) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T11:32:56Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T11:33:07Z,direct_url=<?>,disk_format='qcow2',id=7a04c5f4-de55-416c-8955-be802fd6bf8e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='88c40a3031b540a29dc52c683b2d1682',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T11:33:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Flavor limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Image limits 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Flavor pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Image pref 0:0:0 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73068) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Got 1 possible topologies {{(pid=73068) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 12:28:11 user nova-compute[73068]: DEBUG nova.virt.hardware [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73068) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1396446432',display_name='tempest-SnapshotDataIntegrityTests-server-1396446432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1396446432',id=52,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2CEZ6xwtcp+Zr1Nr1YTOWpKIkDu2FMCny32xDgHeaWGecwo39MdDU7vDvKVbhmXhjA6tC68dgRYH9tb0/ygWO90zgyV4oh+hqPp7vx1A3Uz7nNOIoBVrFTmixpP4HRKg==',key_name='tempest-keypair-590448929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0efeac9dfa314ac281ee27f33249297b',ramdisk_id='',reservation_id='r-um7d1o9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-216422123',owner_user_name='tempest-SnapshotDataIntegrityTests-216422123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d8101fb817b44e5bb66f883e1dddaf3',uuid=3790c4fd-5f8f-4781-ae30-745e0a31df9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73068) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Converting VIF {"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:67:d0,bridge_name='br-int',has_traffic_filtering=True,id=215cca44-7d41-4717-b376-b3b9b1fe6da1,network=Network(57e8cbfe-4080-4cca-ba3d-0410c132623e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215cca44-7d') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.objects.instance [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'pci_devices' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 12:28:12 user nova-compute[73068]:   <uuid>3790c4fd-5f8f-4781-ae30-745e0a31df9e</uuid>
Aug 26 12:28:12 user nova-compute[73068]:   <name>instance-00000034</name>
Aug 26 12:28:12 user nova-compute[73068]:   <memory>524288</memory>
Aug 26 12:28:12 user nova-compute[73068]:   <vcpu>1</vcpu>
Aug 26 12:28:12 user nova-compute[73068]:   <metadata>
Aug 26 12:28:12 user nova-compute[73068]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 12:28:12 user nova-compute[73068]:       <nova:package version="0.0.0"/>
Aug 26 12:28:12 user nova-compute[73068]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1396446432</nova:name>
Aug 26 12:28:12 user nova-compute[73068]:       <nova:creationTime>2023-08-26 12:28:11</nova:creationTime>
Aug 26 12:28:12 user nova-compute[73068]:       <nova:flavor name="m1.tiny">
Aug 26 12:28:12 user nova-compute[73068]:         <nova:memory>512</nova:memory>
Aug 26 12:28:12 user nova-compute[73068]:         <nova:disk>1</nova:disk>
Aug 26 12:28:12 user nova-compute[73068]:         <nova:swap>0</nova:swap>
Aug 26 12:28:12 user nova-compute[73068]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 12:28:12 user nova-compute[73068]:         <nova:vcpus>1</nova:vcpus>
Aug 26 12:28:12 user nova-compute[73068]:       </nova:flavor>
Aug 26 12:28:12 user nova-compute[73068]:       <nova:owner>
Aug 26 12:28:12 user nova-compute[73068]:         <nova:user uuid="0d8101fb817b44e5bb66f883e1dddaf3">tempest-SnapshotDataIntegrityTests-216422123-project-member</nova:user>
Aug 26 12:28:12 user nova-compute[73068]:         <nova:project uuid="0efeac9dfa314ac281ee27f33249297b">tempest-SnapshotDataIntegrityTests-216422123</nova:project>
Aug 26 12:28:12 user nova-compute[73068]:       </nova:owner>
Aug 26 12:28:12 user nova-compute[73068]:       <nova:root type="image" uuid="7a04c5f4-de55-416c-8955-be802fd6bf8e"/>
Aug 26 12:28:12 user nova-compute[73068]:       <nova:ports>
Aug 26 12:28:12 user nova-compute[73068]:         <nova:port uuid="215cca44-7d41-4717-b376-b3b9b1fe6da1">
Aug 26 12:28:12 user nova-compute[73068]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 12:28:12 user nova-compute[73068]:         </nova:port>
Aug 26 12:28:12 user nova-compute[73068]:       </nova:ports>
Aug 26 12:28:12 user nova-compute[73068]:     </nova:instance>
Aug 26 12:28:12 user nova-compute[73068]:   </metadata>
Aug 26 12:28:12 user nova-compute[73068]:   <sysinfo type="smbios">
Aug 26 12:28:12 user nova-compute[73068]:     <system>
Aug 26 12:28:12 user nova-compute[73068]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 12:28:12 user nova-compute[73068]:       <entry name="product">OpenStack Nova</entry>
Aug 26 12:28:12 user nova-compute[73068]:       <entry name="version">0.0.0</entry>
Aug 26 12:28:12 user nova-compute[73068]:       <entry name="serial">3790c4fd-5f8f-4781-ae30-745e0a31df9e</entry>
Aug 26 12:28:12 user nova-compute[73068]:       <entry name="uuid">3790c4fd-5f8f-4781-ae30-745e0a31df9e</entry>
Aug 26 12:28:12 user nova-compute[73068]:       <entry name="family">Virtual Machine</entry>
Aug 26 12:28:12 user nova-compute[73068]:     </system>
Aug 26 12:28:12 user nova-compute[73068]:   </sysinfo>
Aug 26 12:28:12 user nova-compute[73068]:   <os>
Aug 26 12:28:12 user nova-compute[73068]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 12:28:12 user nova-compute[73068]:     <boot dev="hd"/>
Aug 26 12:28:12 user nova-compute[73068]:     <smbios mode="sysinfo"/>
Aug 26 12:28:12 user nova-compute[73068]:   </os>
Aug 26 12:28:12 user nova-compute[73068]:   <features>
Aug 26 12:28:12 user nova-compute[73068]:     <acpi/>
Aug 26 12:28:12 user nova-compute[73068]:     <apic/>
Aug 26 12:28:12 user nova-compute[73068]:     <vmcoreinfo/>
Aug 26 12:28:12 user nova-compute[73068]:   </features>
Aug 26 12:28:12 user nova-compute[73068]:   <clock offset="utc">
Aug 26 12:28:12 user nova-compute[73068]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 12:28:12 user nova-compute[73068]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 12:28:12 user nova-compute[73068]:     <timer name="hpet" present="no"/>
Aug 26 12:28:12 user nova-compute[73068]:   </clock>
Aug 26 12:28:12 user nova-compute[73068]:   <cpu mode="custom" match="exact">
Aug 26 12:28:12 user nova-compute[73068]:     <model>Nehalem</model>
Aug 26 12:28:12 user nova-compute[73068]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 12:28:12 user nova-compute[73068]:   </cpu>
Aug 26 12:28:12 user nova-compute[73068]:   <devices>
Aug 26 12:28:12 user nova-compute[73068]:     <disk type="file" device="disk">
Aug 26 12:28:12 user nova-compute[73068]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 12:28:12 user nova-compute[73068]:       <source file="/opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk"/>
Aug 26 12:28:12 user nova-compute[73068]:       <target dev="vda" bus="virtio"/>
Aug 26 12:28:12 user nova-compute[73068]:     </disk>
Aug 26 12:28:12 user nova-compute[73068]:     <interface type="ethernet">
Aug 26 12:28:12 user nova-compute[73068]:       <mac address="fa:16:3e:c7:67:d0"/>
Aug 26 12:28:12 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:28:12 user nova-compute[73068]:       <mtu size="1442"/>
Aug 26 12:28:12 user nova-compute[73068]:       <target dev="tap215cca44-7d"/>
Aug 26 12:28:12 user nova-compute[73068]:     </interface>
Aug 26 12:28:12 user nova-compute[73068]:     <serial type="pty">
Aug 26 12:28:12 user nova-compute[73068]:       <log file="/opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/console.log" append="off"/>
Aug 26 12:28:12 user nova-compute[73068]:     </serial>
Aug 26 12:28:12 user nova-compute[73068]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 12:28:12 user nova-compute[73068]:     <video>
Aug 26 12:28:12 user nova-compute[73068]:       <model type="virtio"/>
Aug 26 12:28:12 user nova-compute[73068]:     </video>
Aug 26 12:28:12 user nova-compute[73068]:     <rng model="virtio">
Aug 26 12:28:12 user nova-compute[73068]:       <backend model="random">/dev/urandom</backend>
Aug 26 12:28:12 user nova-compute[73068]:     </rng>
Aug 26 12:28:12 user nova-compute[73068]:     <controller type="usb" index="0" model="none"/>
Aug 26 12:28:12 user nova-compute[73068]:     <memballoon model="virtio">
Aug 26 12:28:12 user nova-compute[73068]:       <stats period="10"/>
Aug 26 12:28:12 user nova-compute[73068]:     </memballoon>
Aug 26 12:28:12 user nova-compute[73068]:   </devices>
Aug 26 12:28:12 user nova-compute[73068]: </domain>
Aug 26 12:28:12 user nova-compute[73068]:  {{(pid=73068) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1396446432',display_name='tempest-SnapshotDataIntegrityTests-server-1396446432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1396446432',id=52,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2CEZ6xwtcp+Zr1Nr1YTOWpKIkDu2FMCny32xDgHeaWGecwo39MdDU7vDvKVbhmXhjA6tC68dgRYH9tb0/ygWO90zgyV4oh+hqPp7vx1A3Uz7nNOIoBVrFTmixpP4HRKg==',key_name='tempest-keypair-590448929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0efeac9dfa314ac281ee27f33249297b',ramdisk_id='',reservation_id='r-um7d1o9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-216422123',owner_user_name='tempest-SnapshotDataIntegrityTests-216422123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T12:28:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d8101fb817b44e5bb66f883e1dddaf3',uuid=3790c4fd-5f8f-4781-ae30-745e0a31df9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Converting VIF {"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:67:d0,bridge_name='br-int',has_traffic_filtering=True,id=215cca44-7d41-4717-b376-b3b9b1fe6da1,network=Network(57e8cbfe-4080-4cca-ba3d-0410c132623e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215cca44-7d') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG os_vif [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:67:d0,bridge_name='br-int',has_traffic_filtering=True,id=215cca44-7d41-4717-b376-b3b9b1fe6da1,network=Network(57e8cbfe-4080-4cca-ba3d-0410c132623e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215cca44-7d') {{(pid=73068) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap215cca44-7d, may_exist=True, interface_attrs={}) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap215cca44-7d, col_values=(('external_ids', {'iface-id': '215cca44-7d41-4717-b376-b3b9b1fe6da1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:67:d0', 'vm-uuid': '3790c4fd-5f8f-4781-ae30-745e0a31df9e'}),), if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:12 user nova-compute[73068]: INFO os_vif [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:67:d0,bridge_name='br-int',has_traffic_filtering=True,id=215cca44-7d41-4717-b376-b3b9b1fe6da1,network=Network(57e8cbfe-4080-4cca-ba3d-0410c132623e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215cca44-7d')
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No VIF found with MAC fa:16:3e:c7:67:d0, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.network.neutron [req-c110b7ba-156f-49bd-bf77-7292ce61ca36 req-1b3f50c2-954f-418b-8b9e-071c640a0262 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updated VIF entry in instance network info cache for port 215cca44-7d41-4717-b376-b3b9b1fe6da1. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG nova.network.neutron [req-c110b7ba-156f-49bd-bf77-7292ce61ca36 req-1b3f50c2-954f-418b-8b9e-071c640a0262 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:28:12 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-c110b7ba-156f-49bd-bf77-7292ce61ca36 req-1b3f50c2-954f-418b-8b9e-071c640a0262 service nova] Releasing lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:28:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:13 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-946207cf-5ad8-49c8-9f70-6d38f1b8b843 req-84319a68-d28f-4022-89a5-79e55821106c service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Received event network-vif-plugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:28:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-946207cf-5ad8-49c8-9f70-6d38f1b8b843 req-84319a68-d28f-4022-89a5-79e55821106c service nova] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:28:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-946207cf-5ad8-49c8-9f70-6d38f1b8b843 req-84319a68-d28f-4022-89a5-79e55821106c service nova] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:28:13 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-946207cf-5ad8-49c8-9f70-6d38f1b8b843 req-84319a68-d28f-4022-89a5-79e55821106c service nova] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:28:13 user nova-compute[73068]: DEBUG nova.compute.manager [req-946207cf-5ad8-49c8-9f70-6d38f1b8b843 req-84319a68-d28f-4022-89a5-79e55821106c service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] No waiting events found dispatching network-vif-plugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:28:13 user nova-compute[73068]: WARNING nova.compute.manager [req-946207cf-5ad8-49c8-9f70-6d38f1b8b843 req-84319a68-d28f-4022-89a5-79e55821106c service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Received unexpected event network-vif-plugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 for instance with vm_state building and task_state spawning.
Aug 26 12:28:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:14 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052895.5135052, 3790c4fd-5f8f-4781-ae30-745e0a31df9e => Resumed> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:28:15 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] VM Resumed (Lifecycle Event)
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Instance event wait completed in 0 seconds for  {{(pid=73068) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Guest created on hypervisor {{(pid=73068) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 12:28:15 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Instance spawned successfully.
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Found default for hw_cdrom_bus of ide {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Found default for hw_disk_bus of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Found default for hw_input_bus of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Found default for hw_pointer_model of None {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Found default for hw_video_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Found default for hw_vif_model of virtio {{(pid=73068) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 12:28:15 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.virt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Emitting event <LifecycleEvent: 1693052895.5167542, 3790c4fd-5f8f-4781-ae30-745e0a31df9e => Started> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:28:15 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] VM Started (Lifecycle Event)
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73068) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 12:28:15 user nova-compute[73068]: INFO nova.compute.manager [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Took 5.53 seconds to spawn the instance on the hypervisor.
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.compute.manager [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:28:15 user nova-compute[73068]: INFO nova.compute.manager [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-2481b73f-53ba-4bc8-8c6c-4dda1b8a777a req-f8aa362b-4895-4cc8-9690-3d5b7b40a73f service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Received event network-vif-plugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2481b73f-53ba-4bc8-8c6c-4dda1b8a777a req-f8aa362b-4895-4cc8-9690-3d5b7b40a73f service nova] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2481b73f-53ba-4bc8-8c6c-4dda1b8a777a req-f8aa362b-4895-4cc8-9690-3d5b7b40a73f service nova] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-2481b73f-53ba-4bc8-8c6c-4dda1b8a777a req-f8aa362b-4895-4cc8-9690-3d5b7b40a73f service nova] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:28:15 user nova-compute[73068]: DEBUG nova.compute.manager [req-2481b73f-53ba-4bc8-8c6c-4dda1b8a777a req-f8aa362b-4895-4cc8-9690-3d5b7b40a73f service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] No waiting events found dispatching network-vif-plugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:28:15 user nova-compute[73068]: WARNING nova.compute.manager [req-2481b73f-53ba-4bc8-8c6c-4dda1b8a777a req-f8aa362b-4895-4cc8-9690-3d5b7b40a73f service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Received unexpected event network-vif-plugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 for instance with vm_state building and task_state spawning.
Aug 26 12:28:15 user nova-compute[73068]: INFO nova.compute.manager [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Took 6.30 seconds to build instance.
Aug 26 12:28:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-ad38a212-8e31-44b2-b89f-ca783ebbaccb tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.390s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:28:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:28:27 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:28:28 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:28:28 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.232765197753906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:28:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:28:29 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:28:30 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:28:31 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:28:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:33 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:28:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:28:36 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:28:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:28:40 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:28:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:28:40 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:28:40 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:28:40 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:28:41 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:28:41 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:28:41 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:28:41 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:28:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:28:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:28:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:28:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:28:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:28:52 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:28:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:29:01 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:29:01 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 12:29:01 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 12:29:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:29:05 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:29:05 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 12:29:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:29:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:29:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:29:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:29:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:29:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:29:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:29:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:29:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:29:28 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:29:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:29:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:29:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:29:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:29:29 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:29:29 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:29:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=25.20440673828125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:29:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:29:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:29:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:29:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:29:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:29:29 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:29:29 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:29:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:29:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:29:30 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:29:30 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:29:30 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:29:31 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:29:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:29:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:29:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:29:35 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:29:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:29:41 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:29:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:29:42 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:29:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:29:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:29:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:29:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:29:42 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:29:42 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:29:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:29:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:29:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:29:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:29:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:29:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:29:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:29:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:29:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:29:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:29:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:01 user nova-compute[73068]: DEBUG nova.compute.manager [req-d6e1c286-e7cb-4fa6-94b3-b987e9681a5b req-18106a64-0b20-4fd8-9b66-23de9aed29f8 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Received event network-changed-215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:30:01 user nova-compute[73068]: DEBUG nova.compute.manager [req-d6e1c286-e7cb-4fa6-94b3-b987e9681a5b req-18106a64-0b20-4fd8-9b66-23de9aed29f8 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Refreshing instance network info cache due to event network-changed-215cca44-7d41-4717-b376-b3b9b1fe6da1. {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 12:30:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d6e1c286-e7cb-4fa6-94b3-b987e9681a5b req-18106a64-0b20-4fd8-9b66-23de9aed29f8 service nova] Acquiring lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:30:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d6e1c286-e7cb-4fa6-94b3-b987e9681a5b req-18106a64-0b20-4fd8-9b66-23de9aed29f8 service nova] Acquired lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:30:01 user nova-compute[73068]: DEBUG nova.network.neutron [req-d6e1c286-e7cb-4fa6-94b3-b987e9681a5b req-18106a64-0b20-4fd8-9b66-23de9aed29f8 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Refreshing network info cache for port 215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 12:30:01 user nova-compute[73068]: DEBUG nova.network.neutron [req-d6e1c286-e7cb-4fa6-94b3-b987e9681a5b req-18106a64-0b20-4fd8-9b66-23de9aed29f8 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updated VIF entry in instance network info cache for port 215cca44-7d41-4717-b376-b3b9b1fe6da1. {{(pid=73068) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 12:30:01 user nova-compute[73068]: DEBUG nova.network.neutron [req-d6e1c286-e7cb-4fa6-94b3-b987e9681a5b req-18106a64-0b20-4fd8-9b66-23de9aed29f8 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:30:01 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-d6e1c286-e7cb-4fa6-94b3-b987e9681a5b req-18106a64-0b20-4fd8-9b66-23de9aed29f8 service nova] Releasing lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:30:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:03 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG nova.objects.instance [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:30:05 user nova-compute[73068]: INFO nova.compute.manager [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attaching volume 2baff7b0-ec05-40dc-bf88-0a3c785bd883 to /dev/vdb
Aug 26 12:30:05 user nova-compute[73068]: DEBUG os_brick.utils [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a11cc2-01ac-4f11-9567-834b39c4f367]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1dbbc6-a275-463d-aab9-7ff1e8f62c13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de20142-36fe-4275-a786-34089c5cf7c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7f3c02-f43c-4e44-9269-540fdb57d8f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:30:05 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:30:05 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8ae734-7310-4ccb-9c47-7dda327eece8]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:30:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:30:06 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:30:06 user nova-compute[73068]: DEBUG os_brick.utils [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:30:06 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating existing volume attachment record: 29085897-f537-4ac1-8c74-12a56c8091e3 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:30:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndoksuqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:30:15 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:30:15 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:30:15 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c3f58b-c89b-4d99-a60a-495deb047db5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:30:15 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8731f14-d9aa-487e-9080-e819ee557ecb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883] added
Aug 26 12:30:15 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[024cdac9-8300-46d6-89fe-71fe0e4f2570]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ab0b9b-6499-47bd-bd4a-859bdc1aa2e3]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ndoksuqI {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ndoksuqI" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0608b485-ebd0-4a11-946d-d13d5c07bdec]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ndoksuqI'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2910c572-9d0e-4b29-b662-4cea2ce860aa]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabd98be-ef04-4813-b04a-9016845684dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:30:15 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:30:15 user nova-compute[73068]:  {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:30:15 user nova-compute[73068]: WARNING os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 12:30:15 user nova-compute[73068]: 
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9b7c60-2570-401f-90da-c245e81a5dec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883, portal: 172.16.0.220,3260]
Aug 26 12:30:15 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883, portal: 172.16.0.220,3260] successful.
Aug 26 12:30:15 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4855ba42-e470-4c40-8eb8-8b5eb06fae73]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:30:15 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ae4f0c-1e34-4c06-8a58-6dd8a743e72c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 (non-flash)
Aug 26 12:30:16 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 (non-flash)
Aug 26 12:30:16 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[45036398-a7c1-4a06-8fc2-aa15e242f0fa]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndoksuqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:30:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:30:17 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23866303938316136', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:30:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866303938316136', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:30:17 user nova-compute[73068]: DEBUG nova.objects.instance [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:30:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 12:30:17 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:30:17 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:30:17 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:30:17 user nova-compute[73068]:   <serial>2baff7b0-ec05-40dc-bf88-0a3c785bd883</serial>
Aug 26 12:30:17 user nova-compute[73068]: </disk>
Aug 26 12:30:17 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 12:30:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:30:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:30:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No VIF found with MAC fa:16:3e:c7:67:d0, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:30:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-aef5ce7b-b74e-45cd-9c89-cfcd32a0d0e9 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.762s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:30:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:30:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:30:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:30:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:30:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:30:28 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:30:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:28 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73068) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 12:30:29 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:30:29 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:30:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=25.203289031982422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:30:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:30:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:30:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:30:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:30:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:30:29 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:30:29 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:30:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:30:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:30:31 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:30:31 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:30:31 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:30:31 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:30:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:30:36 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:30:36 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:30:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:30:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:30:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:30:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:30:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:41 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:30:41 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:42 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:30:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:30:42 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:30:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:30:42 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:30:42 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:30:42 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:30:43 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:30:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:30:43 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:30:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:30:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:30:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:30:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:30:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:30:48 user nova-compute[73068]: INFO nova.compute.manager [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Detaching volume 2baff7b0-ec05-40dc-bf88-0a3c785bd883
Aug 26 12:30:48 user nova-compute[73068]: INFO nova.virt.block_device [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attempting to driver detach volume 2baff7b0-ec05-40dc-bf88-0a3c785bd883 from mountpoint /dev/vdb
Aug 26 12:30:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Attempting to detach device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:30:48 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:30:48 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:30:48 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:30:48 user nova-compute[73068]:   <serial>2baff7b0-ec05-40dc-bf88-0a3c785bd883</serial>
Aug 26 12:30:48 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:30:48 user nova-compute[73068]: </disk>
Aug 26 12:30:48 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:30:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Successfully detached device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the persistent domain config.
Aug 26 12:30:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:30:48 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:30:48 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:30:48 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:30:48 user nova-compute[73068]:   <serial>2baff7b0-ec05-40dc-bf88-0a3c785bd883</serial>
Aug 26 12:30:48 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:30:48 user nova-compute[73068]: </disk>
Aug 26 12:30:48 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693053048.8888943, 3790c4fd-5f8f-4781-ae30-745e0a31df9e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 12:30:48 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Successfully detached device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the live domain config.
Aug 26 12:30:48 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ndoksuqI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:30:48 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:30:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3473001-6176-458b-832e-10c1700333f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99c606d-3ca2-47bf-b3b3-4be70767b129]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 (non-flash)
Aug 26 12:30:48 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 (non-flash)
Aug 26 12:30:48 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fddbf8f9d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f697d2-df24-4e65-99fc-a2fc8ef9670b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2932ac-2e9d-4ecf-a892-f5fe25ca1960]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:30:48 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9c5211-7a2e-4f2a-9b2d-e153d7d9c460]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0ad5ef-0b50-4f91-a464-5f81f8e09d05]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67531c6-5d68-4463-8b16-23ad64cd4957]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[655f4847-ef67-4a8e-887b-2023ee1a21f1]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883, portal: 172.16.0.220,3260]
Aug 26 12:30:49 user nova-compute[73068]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883, portal: 172.16.0.220,3260] successful.
Aug 26 12:30:49 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2baff7b0-ec05-40dc-bf88-0a3c785bd883 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a310bfc-5638-463e-9cc2-4031ef9f7b1e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== disconnect_volume: return (264ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG nova.objects.instance [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:30:49 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-d2e77d6a-30f1-4401-adab-9c4b6a4f8780 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.597s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:30:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:30:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:30:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:30:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:30:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:30:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:30:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:31:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:31:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:31:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:31:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:31:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:31:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:31:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:31:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:31:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:31:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:31:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:31:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:31:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:31:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:31:28 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:31:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:29 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:31:29 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:31:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8823MB free_disk=25.202381134033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:31:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:31:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:31:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:31:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:31:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:31:29 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:31:29 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:31:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:31:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:31:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:31:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:31:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:31:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:31:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:31:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:31:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:31:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:31:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:31:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:31:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:31:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:31:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:31:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:42 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG nova.objects.instance [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:31:43 user nova-compute[73068]: INFO nova.compute.manager [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attaching volume 75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 to /dev/vdb
Aug 26 12:31:43 user nova-compute[73068]: DEBUG os_brick.utils [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd702a43-b528-4570-a5dc-552f9ec3922c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bed2e5-bf3e-4a9f-93f7-9c6ffc948441]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afb8d1d-8da8-416d-bd72-42aa9076dbd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ec3635-4b16-47f5-afff-ba437a4042cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:31:43 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:31:43 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f999181-8489-4644-b373-e3458daf9288]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:31:43 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:31:44 user nova-compute[73068]: DEBUG os_brick.utils [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:31:44 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating existing volume attachment record: c4a48de3-9fd7-45c3-9c09-905e825149f2 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:31:44 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:31:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:31:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:31:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:31:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:31:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:31:44 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:31:45 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:31:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:31:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:31:46 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:31:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:31:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:31:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:31:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpjeKHaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:31:54 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:31:54 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:31:54 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5eccb4-458c-4df5-8ed2-2e7c184fae97]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:31:54 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e780a2-06ab-4dfe-b775-bf526539b454]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8] added
Aug 26 12:31:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c1fd75-e4bb-4b4b-9953-e89d6006e401]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb35ac89-c481-4634-a2ee-0d276a423c80]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpjeKHaL {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZpjeKHaL" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a2ca69-c4c2-45ef-a8e7-7f9bca2dab5a]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZpjeKHaL'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ba0b02-dfbf-416b-a239-cafffabd0c0c]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a29470e-35c8-4257-826a-019db2065eee]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:31:54 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:31:54 user nova-compute[73068]:  {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:31:54 user nova-compute[73068]: WARNING os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 12:31:54 user nova-compute[73068]: 
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5f27ca-beb0-45d8-b4fb-8f01f6950c5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8, portal: 172.16.0.220,3260]
Aug 26 12:31:54 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8, portal: 172.16.0.220,3260] successful.
Aug 26 12:31:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[128c5810-02be-4e17-8bd7-f99a5001ac02]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2817ac3e-3cae-496f-b893-8a21f574fba8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 (non-flash)
Aug 26 12:31:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 (non-flash)
Aug 26 12:31:54 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c31713-e9ea-478f-9975-be92f1dc8663]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:54 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:31:55 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:31:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpjeKHaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:31:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:31:55 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23431356131386333', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:31:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431356131386333', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:31:55 user nova-compute[73068]: DEBUG nova.objects.instance [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:31:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 12:31:55 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:31:55 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:31:55 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:31:55 user nova-compute[73068]:   <serial>75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8</serial>
Aug 26 12:31:55 user nova-compute[73068]: </disk>
Aug 26 12:31:55 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 12:31:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:31:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:31:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No VIF found with MAC fa:16:3e:c7:67:d0, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:31:55 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-207f57f2-2ced-413a-943e-486eb461ca74 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.143s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:31:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:31:58 user nova-compute[73068]: INFO nova.compute.manager [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Detaching volume 75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8
Aug 26 12:31:58 user nova-compute[73068]: INFO nova.virt.block_device [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attempting to driver detach volume 75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 from mountpoint /dev/vdb
Aug 26 12:31:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Attempting to detach device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:31:58 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:31:58 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:31:58 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:31:58 user nova-compute[73068]:   <serial>75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8</serial>
Aug 26 12:31:58 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:31:58 user nova-compute[73068]: </disk>
Aug 26 12:31:58 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:31:58 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Successfully detached device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the persistent domain config.
Aug 26 12:31:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:31:58 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:31:58 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:31:58 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:31:58 user nova-compute[73068]:   <serial>75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8</serial>
Aug 26 12:31:58 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:31:58 user nova-compute[73068]: </disk>
Aug 26 12:31:58 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693053118.9306865, 3790c4fd-5f8f-4781-ae30-745e0a31df9e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 12:31:58 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Successfully detached device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the live domain config.
Aug 26 12:31:58 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZpjeKHaL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:31:58 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:31:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[768104e9-a9ba-4d24-959c-4f02179ac255]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[622c8dc8-2941-452d-aae8-326766cbf1dc]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 (non-flash)
Aug 26 12:31:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:31:58 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 (non-flash)
Aug 26 12:31:58 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd901f7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa2c5b4-91a0-4b37-bdf0-c963eb783bd3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5c2310-9bf8-4c10-af0b-0b980b84d2a1]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[a785940f-4a8a-4387-9f62-90c711f3acbd]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3276ba-b7a9-4156-9a4a-77a8c592d9be]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[50946138-927c-4ec2-ae23-7fa1f5f92890]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc8ba0a-75ee-4e0a-b3c1-777ae95a5b66]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8, portal: 172.16.0.220,3260]
Aug 26 12:31:59 user nova-compute[73068]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8, portal: 172.16.0.220,3260] successful.
Aug 26 12:31:59 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75cfb6f8-8f7a-43f2-8e50-b8eb8ac9aca8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0144d8-0d0b-4aa5-b7aa-d9b5a6107c87]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== disconnect_volume: return (295ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:31:59 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:32:00 user nova-compute[73068]: DEBUG nova.objects.instance [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:32:00 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-0a37fcb5-1539-4f7e-aa70-a6caae655372 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.758s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:32:01 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:05 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:32:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:32:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:32:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:32:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:32:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:32:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:32:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:32:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:32:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:32:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:32:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:28 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:32:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:32:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:32:28 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:32:28 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:32:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:32:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:32:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:32:28 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:32:29 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:32:29 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:32:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.201305389404297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:32:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:32:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:32:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:32:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:32:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:32:29 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:32:29 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:32:29 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:32:29 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:32:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:32:32 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:32:33 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:32:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:32:35 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:32:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:32:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:32:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:32:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:32:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:32:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:32:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:32:44 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:32:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:32:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:32:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:32:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:32:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:32:44 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:32:45 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:32:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:32:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:32:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:32:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG nova.objects.instance [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:32:53 user nova-compute[73068]: INFO nova.compute.manager [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attaching volume 575c1272-7bca-4c0b-9c7a-67113fdc16d6 to /dev/vdb
Aug 26 12:32:53 user nova-compute[73068]: DEBUG os_brick.utils [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb7b59a-cee3-4e50-ba53-e7a42b411229]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b371253-26d5-4b07-93d6-79de2a550c99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb36ba-5d2c-4c25-a2cd-a6e1b31d8133]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c5c3fb-1b36-40af-8fd7-4422fdb47a8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:32:53 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:32:53 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8187272e-44d2-49e9-b93b-5d49e9c974a3]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG os_brick.utils [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:32:53 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating existing volume attachment record: 0be22bec-59e5-4791-b0c1-4232fbaf1698 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:32:56 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:32:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:33:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:33:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:33:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:33:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDsGLNbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:33:04 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:33:04 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:33:04 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562db18-fee1-413a-ab93-575ab77ac417]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:33:04 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b58b25-51f4-40ab-b774-6d1125e1c68c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6] added
Aug 26 12:33:04 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8be913-6bfa-4c0a-9663-79320a3a7f7e]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ddb2c6-817f-42ca-9b89-902faa6ba9d2]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDsGLNbx {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDsGLNbx" returned: 0 in 0.033s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe29f45c-3d0e-4933-be12-f85f0c1c481d]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jDsGLNbx'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f7ac56-7948-4dd5-88fc-993da5b783d1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[378ad3fa-4062-4b33-871b-0afe87ac2c51]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:33:04 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:33:04 user nova-compute[73068]:  {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:33:04 user nova-compute[73068]: WARNING os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 12:33:04 user nova-compute[73068]: 
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adac391-0e52-4885-9dbb-fb5efdd32fd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6, portal: 172.16.0.220,3260]
Aug 26 12:33:04 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6, portal: 172.16.0.220,3260] successful.
Aug 26 12:33:04 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c18e22e-caa4-4557-9b94-b1b7b98b0063]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b6100d-8308-4e63-83f8-2a64ca2b8676]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 (non-flash)
Aug 26 12:33:04 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 (non-flash)
Aug 26 12:33:04 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75faeb8-1991-47fd-b8b2-1b1841813c8f]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:33:04 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDsGLNbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:33:05 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:33:05 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26466363731633061', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:33:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466363731633061', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:33:05 user nova-compute[73068]: DEBUG nova.objects.instance [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:33:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 12:33:05 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:33:05 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:33:05 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:33:05 user nova-compute[73068]:   <serial>575c1272-7bca-4c0b-9c7a-67113fdc16d6</serial>
Aug 26 12:33:05 user nova-compute[73068]: </disk>
Aug 26 12:33:05 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 12:33:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:33:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:33:05 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No VIF found with MAC fa:16:3e:c7:67:d0, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:33:05 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-54ee95e1-495c-462a-95ac-36c4f08d44fa tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.160s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:33:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:33:08 user nova-compute[73068]: INFO nova.compute.manager [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Detaching volume 575c1272-7bca-4c0b-9c7a-67113fdc16d6
Aug 26 12:33:08 user nova-compute[73068]: INFO nova.virt.block_device [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attempting to driver detach volume 575c1272-7bca-4c0b-9c7a-67113fdc16d6 from mountpoint /dev/vdb
Aug 26 12:33:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Attempting to detach device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:33:08 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:33:08 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:33:08 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:33:08 user nova-compute[73068]:   <serial>575c1272-7bca-4c0b-9c7a-67113fdc16d6</serial>
Aug 26 12:33:08 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:33:08 user nova-compute[73068]: </disk>
Aug 26 12:33:08 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:33:08 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Successfully detached device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the persistent domain config.
Aug 26 12:33:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:33:08 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:33:08 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:33:08 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:33:08 user nova-compute[73068]:   <serial>575c1272-7bca-4c0b-9c7a-67113fdc16d6</serial>
Aug 26 12:33:08 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:33:08 user nova-compute[73068]: </disk>
Aug 26 12:33:08 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693053188.7926068, 3790c4fd-5f8f-4781-ae30-745e0a31df9e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 12:33:08 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Successfully detached device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the live domain config.
Aug 26 12:33:08 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDsGLNbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:33:08 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ced563-c1b6-4943-8c8b-6c609ab6fc12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f7742a-3fe5-4f77-bf06-936d9d2b158f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 (non-flash)
Aug 26 12:33:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 (non-flash)
Aug 26 12:33:08 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd90298700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5833fe45-e3a4-479b-835e-2b89b337e571]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebcdd5d-c0c9-4ae9-a302-f6a261bf116d]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[566df481-218c-4ca9-b2b8-b14cead0dcba]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d02ef3a-a606-46f3-9ca4-cbd9b4fb891b]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:33:08 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff031c0-aac0-49df-ba35-199a594e83a0]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59440f0-0a89-4020-b231-ac3be732bb59]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6, portal: 172.16.0.220,3260]
Aug 26 12:33:09 user nova-compute[73068]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6, portal: 172.16.0.220,3260] successful.
Aug 26 12:33:09 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575c1272-7bca-4c0b-9c7a-67113fdc16d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6385d68-2991-457b-a54a-8f1f347473d6]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== disconnect_volume: return (282ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG nova.objects.instance [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:33:09 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-62fb7132-bd97-4278-8192-4b2a1fe09e4f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.627s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:33:11 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:14 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:33:14 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Triggering sync for uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 12:33:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:33:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:33:14 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:33:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:33:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:33:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:33:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:33:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:33:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:33:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:33:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:33:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:33:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:30 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:33:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:33:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:33:30 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:33:30 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:33:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:33:30 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:33:31 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:33:31 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=25.200340270996094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing inventories for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating ProviderTree inventory for provider e49cbbd6-e608-41cf-a55c-7dee214caafe from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Updating inventory in ProviderTree for provider e49cbbd6-e608-41cf-a55c-7dee214caafe with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing aggregate associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, aggregates: None {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Refreshing trait associations for resource provider e49cbbd6-e608-41cf-a55c-7dee214caafe, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=73068) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:33:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:33:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:33:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:33:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:33:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:33:35 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:33:35 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:33:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:33:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:33:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:33:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:33:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:33:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:33:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:33:44 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:33:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:33:44 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:33:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:33:44 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:33:44 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:33:44 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:33:45 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:33:45 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:33:45 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:33:45 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:33:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:33:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:33:56 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:33:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:34:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:34:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:34:02 user nova-compute[73068]: DEBUG nova.objects.instance [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:34:02 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:34:03 user nova-compute[73068]: INFO nova.compute.manager [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attaching volume d800dcbc-7faa-466f-81ba-eaf3c2fe5249 to /dev/vdb
Aug 26 12:34:03 user nova-compute[73068]: DEBUG os_brick.utils [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24bff4f-b4db-4ad7-a6d8-55c0f139974b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b0e0307b6999\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[233e7739-a07e-4252-afde-c4f0425a1d1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[da753e69-203e-4a1a-9b34-6efc1cab1215]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbe26f1-d76e-42c2-b6ed-718558539881]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Running cmd (subprocess): nvme version {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] 'nvme version' failed. Not Retrying. {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] nvme not present on system {{(pid=73068) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 12:34:03 user nova-compute[73068]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 12:34:03 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab0330d-534b-45cb-9936-692ab5c2e445]: (4, '') {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73068) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.lightos [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] LIGHTOS: no hostnqn found. {{(pid=73068) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG os_brick.utils [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b0e0307b6999', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:34:03 user nova-compute[73068]: DEBUG nova.virt.block_device [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating existing volume attachment record: 096df223-d9d6-4874-babf-83950cc99768 {{(pid=73068) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 12:34:05 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:06 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:09 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] There are 0 instances to clean {{(pid=73068) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73068) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Calling os-brick to attach iSCSI Volume {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgLeZWTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:34:13 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:34:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:34:13 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:34:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:34:13 user nova-compute[73068]: INFO os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[28971160-3dc7-4246-b69a-3eefbe6950a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 12:34:13 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --interface default --op new {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef06f75-9c77-44a2-8807-327e6aa74a69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249] added\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249] added
Aug 26 12:34:13 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dd8a92-c20e-4797-87f7-75c0f2b1c703]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:13 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cdf29e-2b60-41a2-84a9-46b1a68dd820]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BgLeZWTd {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BgLeZWTd" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd26738-3da5-4361-90ac-e4bc2c403bc1]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BgLeZWTd'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[347b7b89-af3c-478c-9f53-78e2867e43a8]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4801706-5641-4b59-9fba-a0e02aeee20b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:34:14 user nova-compute[73068]:  {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 12:34:14 user nova-compute[73068]:  {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:34:14 user nova-compute[73068]: WARNING os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 12:34:14 user nova-compute[73068]: 
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --login {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5ec4b4-7558-4e7a-9239-85953626ce30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249, portal: 172.16.0.220,3260]
Aug 26 12:34:14 user nova-compute[73068]: Login to [iface: default, target: iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249, portal: 172.16.0.220,3260] successful.
Aug 26 12:34:14 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50f695d-54a7-46f6-825e-f8cde90d4412]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f96f7e-5a7f-4ef1-8e28-f0527afbf383]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 (non-flash)
Aug 26 12:34:14 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 (non-flash)
Aug 26 12:34:14 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Connected to 172.16.0.220:3260 {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73068) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73068) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bba1e6c-c5ad-445b-8b55-8bfa7ead5697]: (4, ('- - 0', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73068) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 12:34:14 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgLeZWTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73068) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 12:34:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:34:15 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26531393761346534', 'path': '/dev/sdb'} {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:34:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531393761346534', 'path': '/dev/sdb'} {{(pid=73068) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 12:34:15 user nova-compute[73068]: DEBUG nova.objects.instance [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:34:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 12:34:15 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:34:15 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:34:15 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:34:15 user nova-compute[73068]:   <serial>d800dcbc-7faa-466f-81ba-eaf3c2fe5249</serial>
Aug 26 12:34:15 user nova-compute[73068]: </disk>
Aug 26 12:34:15 user nova-compute[73068]:  {{(pid=73068) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 12:34:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No BDM found with device name vda, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:34:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73068) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 12:34:15 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] No VIF found with MAC fa:16:3e:c7:67:d0, not building metadata {{(pid=73068) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 12:34:15 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-7e233a92-cadc-45f4-8296-bac602f47ce3 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.301s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:34:16 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:34:17 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:34:17 user nova-compute[73068]: INFO nova.compute.manager [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Detaching volume d800dcbc-7faa-466f-81ba-eaf3c2fe5249
Aug 26 12:34:17 user nova-compute[73068]: INFO nova.virt.block_device [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Attempting to driver detach volume d800dcbc-7faa-466f-81ba-eaf3c2fe5249 from mountpoint /dev/vdb
Aug 26 12:34:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Attempting to detach device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the persistent domain config. {{(pid=73068) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 12:34:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:34:17 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:34:17 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:34:17 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:34:17 user nova-compute[73068]:   <serial>d800dcbc-7faa-466f-81ba-eaf3c2fe5249</serial>
Aug 26 12:34:17 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:34:17 user nova-compute[73068]: </disk>
Aug 26 12:34:17 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:34:17 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Successfully detached device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the persistent domain config.
Aug 26 12:34:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the live domain config. {{(pid=73068) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 12:34:17 user nova-compute[73068]: DEBUG nova.virt.libvirt.guest [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 12:34:17 user nova-compute[73068]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 12:34:17 user nova-compute[73068]:   <source dev="/dev/sdb"/>
Aug 26 12:34:17 user nova-compute[73068]:   <target dev="vdb" bus="virtio"/>
Aug 26 12:34:17 user nova-compute[73068]:   <serial>d800dcbc-7faa-466f-81ba-eaf3c2fe5249</serial>
Aug 26 12:34:17 user nova-compute[73068]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 12:34:17 user nova-compute[73068]: </disk>
Aug 26 12:34:17 user nova-compute[73068]:  {{(pid=73068) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-6716a760-d265-4ea4-8ce1-c857addb9356 None None] Received event <DeviceRemovedEvent: 1693053258.4387834, 3790c4fd-5f8f-4781-ae30-745e0a31df9e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73068) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.driver [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 12:34:18 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Successfully detached device vdb from instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e from the live domain config.
Aug 26 12:34:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] calling os-brick to detach iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fddb00f4040>, {'target_iqns': ['iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BgLeZWTd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 12:34:18 user nova-compute[73068]: WARNING os_brick.initiator.connectors.base [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249', 0)] {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c929087-e9e4-47dd-b7c8-c133850bcbe3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd3dbfe-22fe-4e1f-9b78-d6a92707a1f9]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 (non-flash)\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 (non-flash)
Aug 26 12:34:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 (non-flash)
Aug 26 12:34:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdd9025b2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249'): ({'sdb'}, set())}) {{(pid=73068) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Removing single pathed devices sdb {{(pid=73068) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44862f7-6f34-4a80-87ac-eb72c9a79ee7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaafdc2-8ee9-442d-8053-1b6edff928e8]: (4, ('ok\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Flushing IO for device /dev/sdb {{(pid=73068) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d51c9c-5725-4702-90f7-dd6cc7b3f8c2]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73068) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[67798d87-4144-487a-81e8-3c2cc207788c]: (4, ('1', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.linuxscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] SCSI volumes sdb have been removed. {{(pid=73068) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249')] {{(pid=73068) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86cf17a-4c02-4a62-93a7-89190fa043dd]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --logout {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d47b02-98be-4706-9fa3-a85587089788]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249, portal: 172.16.0.220,3260]
Aug 26 12:34:18 user nova-compute[73068]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249, portal: 172.16.0.220,3260] successful.
Aug 26 12:34:18 user nova-compute[73068]:  stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op delete {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d800dcbc-7faa-466f-81ba-eaf3c2fe5249 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83861) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG oslo.privsep.daemon [-] privsep: reply[b955d579-88ec-4444-a029-e8bcbb4e3631]: (4, ('', '')) {{(pid=83861) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73068) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.base [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] <== disconnect_volume: return (262ms) None {{(pid=73068) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 12:34:18 user nova-compute[73068]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Disconnected iSCSI Volume {{(pid=73068) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 12:34:19 user nova-compute[73068]: DEBUG nova.objects.instance [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'flavor' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:34:19 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-b8f559a6-c9b9-4fd4-9de5-0129c30514b0 tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.596s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:34:21 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:31 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:34:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:34:31 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:34:31 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:34:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:34:31 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:34:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:32 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:34:32 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:34:32 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8790MB free_disk=25.191513061523438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:34:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:34:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:34:32 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:34:32 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:34:32 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:34:32 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:34:32 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:34:32 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:34:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:34:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:34:35 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:34:37 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:37 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:34:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:34:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:34:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:34:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:34:46 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:34:46 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:34:47 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:34:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:34:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:34:47 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:34:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:34:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:34:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:34:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:34:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:34:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:34:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:34:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:34:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:34:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:34:57 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:02 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:07 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:35:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:35:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:35:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:35:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:35:12 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:35:17 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:22 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:27 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 12:35:32 user nova-compute[73068]: DEBUG oslo_concurrency.processutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73068) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 12:35:33 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:35:33 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:35:33 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.190704345703125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:35:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:35:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:35:33 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73068) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 12:35:33 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:35:33 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:35:33 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:35:33 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:35:33 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:35:33 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:35:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:35:34 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:35:36 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:35:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:35:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:35:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:35:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:35:37 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:35:37 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:35:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:35:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:35:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:35:42 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:46 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:35:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:35:46 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:35:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 12:35:46 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquired lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 12:35:46 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Forcefully refreshing network info cache for instance {{(pid=73068) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 12:35:46 user nova-compute[73068]: DEBUG nova.objects.instance [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lazy-loading 'info_cache' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:35:47 user nova-compute[73068]: DEBUG nova.network.neutron [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [{"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:35:47 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Releasing lock "refresh_cache-3790c4fd-5f8f-4781-ae30-745e0a31df9e" {{(pid=73068) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 12:35:47 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updated the network info_cache for instance {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 12:35:47 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:35:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:35:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:35:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:35:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:35:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:35:47 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:35:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:35:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:35:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:35:52 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:35:54 user nova-compute[73068]: INFO nova.compute.manager [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Terminating instance
Aug 26 12:35:54 user nova-compute[73068]: DEBUG nova.compute.manager [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Start destroying the instance on the hypervisor. {{(pid=73068) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-3916368b-6e4b-4020-8367-6d58340463da req-cda981a0-1f3c-42b4-9dc2-ef50ade74d13 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Received event network-vif-unplugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3916368b-6e4b-4020-8367-6d58340463da req-cda981a0-1f3c-42b4-9dc2-ef50ade74d13 service nova] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3916368b-6e4b-4020-8367-6d58340463da req-cda981a0-1f3c-42b4-9dc2-ef50ade74d13 service nova] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-3916368b-6e4b-4020-8367-6d58340463da req-cda981a0-1f3c-42b4-9dc2-ef50ade74d13 service nova] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-3916368b-6e4b-4020-8367-6d58340463da req-cda981a0-1f3c-42b4-9dc2-ef50ade74d13 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] No waiting events found dispatching network-vif-unplugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG nova.compute.manager [req-3916368b-6e4b-4020-8367-6d58340463da req-cda981a0-1f3c-42b4-9dc2-ef50ade74d13 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Received event network-vif-unplugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 for instance with task_state deleting. {{(pid=73068) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 12:35:54 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:55 user nova-compute[73068]: INFO nova.virt.libvirt.driver [-] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Instance destroyed successfully.
Aug 26 12:35:55 user nova-compute[73068]: DEBUG nova.objects.instance [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lazy-loading 'resources' on Instance uuid 3790c4fd-5f8f-4781-ae30-745e0a31df9e {{(pid=73068) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 12:35:55 user nova-compute[73068]: DEBUG nova.virt.libvirt.vif [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T12:28:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1396446432',display_name='tempest-SnapshotDataIntegrityTests-server-1396446432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1396446432',id=52,image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2CEZ6xwtcp+Zr1Nr1YTOWpKIkDu2FMCny32xDgHeaWGecwo39MdDU7vDvKVbhmXhjA6tC68dgRYH9tb0/ygWO90zgyV4oh+hqPp7vx1A3Uz7nNOIoBVrFTmixpP4HRKg==',key_name='tempest-keypair-590448929',keypairs=<?>,launch_index=0,launched_at=2023-08-26T12:28:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0efeac9dfa314ac281ee27f33249297b',ramdisk_id='',reservation_id='r-um7d1o9o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7a04c5f4-de55-416c-8955-be802fd6bf8e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-216422123',owner_user_name='tempest-SnapshotDataIntegrityTests-216422123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T12:28:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d8101fb817b44e5bb66f883e1dddaf3',uuid=3790c4fd-5f8f-4781-ae30-745e0a31df9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 12:35:55 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Converting VIF {"id": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "address": "fa:16:3e:c7:67:d0", "network": {"id": "57e8cbfe-4080-4cca-ba3d-0410c132623e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-137936014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0efeac9dfa314ac281ee27f33249297b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap215cca44-7d", "ovs_interfaceid": "215cca44-7d41-4717-b376-b3b9b1fe6da1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 12:35:55 user nova-compute[73068]: DEBUG nova.network.os_vif_util [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:67:d0,bridge_name='br-int',has_traffic_filtering=True,id=215cca44-7d41-4717-b376-b3b9b1fe6da1,network=Network(57e8cbfe-4080-4cca-ba3d-0410c132623e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215cca44-7d') {{(pid=73068) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 12:35:55 user nova-compute[73068]: DEBUG os_vif [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:67:d0,bridge_name='br-int',has_traffic_filtering=True,id=215cca44-7d41-4717-b376-b3b9b1fe6da1,network=Network(57e8cbfe-4080-4cca-ba3d-0410c132623e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215cca44-7d') {{(pid=73068) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 12:35:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap215cca44-7d, bridge=br-int, if_exists=True) {{(pid=73068) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 12:35:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:35:55 user nova-compute[73068]: INFO os_vif [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:67:d0,bridge_name='br-int',has_traffic_filtering=True,id=215cca44-7d41-4717-b376-b3b9b1fe6da1,network=Network(57e8cbfe-4080-4cca-ba3d-0410c132623e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap215cca44-7d')
Aug 26 12:35:55 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Deleting instance files /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e_del
Aug 26 12:35:55 user nova-compute[73068]: INFO nova.virt.libvirt.driver [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Deletion of /opt/stack/data/nova/instances/3790c4fd-5f8f-4781-ae30-745e0a31df9e_del complete
Aug 26 12:35:55 user nova-compute[73068]: INFO nova.compute.manager [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 26 12:35:55 user nova-compute[73068]: DEBUG oslo.service.loopingcall [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73068) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 12:35:55 user nova-compute[73068]: DEBUG nova.compute.manager [-] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Deallocating network for instance {{(pid=73068) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 12:35:55 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] deallocate_for_instance() {{(pid=73068) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 12:35:55 user nova-compute[73068]: DEBUG nova.network.neutron [-] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Updating instance_info_cache with network_info: [] {{(pid=73068) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 12:35:55 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Took 0.85 seconds to deallocate network for instance.
Aug 26 12:35:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:35:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:35:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-2f57b784-dff4-4280-beb0-5bbd8f0db9a7 req-51740cac-4f99-44bb-9055-eab6728fac4f service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Received event network-vif-deleted-215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:35:56 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:35:56 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:35:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:35:56 user nova-compute[73068]: INFO nova.scheduler.client.report [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Deleted allocations for instance 3790c4fd-5f8f-4781-ae30-745e0a31df9e
Aug 26 12:35:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-469b1518-8e26-4959-86d1-4d2cef85252f tempest-SnapshotDataIntegrityTests-216422123 tempest-SnapshotDataIntegrityTests-216422123-project-member] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.061s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:35:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-1fa6ccb4-62ba-4d5b-acb6-7f1b2ea55a89 req-a0b44d45-bf44-494a-871a-44b6d12aad93 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Received event network-vif-plugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 12:35:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1fa6ccb4-62ba-4d5b-acb6-7f1b2ea55a89 req-a0b44d45-bf44-494a-871a-44b6d12aad93 service nova] Acquiring lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:35:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1fa6ccb4-62ba-4d5b-acb6-7f1b2ea55a89 req-a0b44d45-bf44-494a-871a-44b6d12aad93 service nova] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:35:56 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [req-1fa6ccb4-62ba-4d5b-acb6-7f1b2ea55a89 req-a0b44d45-bf44-494a-871a-44b6d12aad93 service nova] Lock "3790c4fd-5f8f-4781-ae30-745e0a31df9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:35:56 user nova-compute[73068]: DEBUG nova.compute.manager [req-1fa6ccb4-62ba-4d5b-acb6-7f1b2ea55a89 req-a0b44d45-bf44-494a-871a-44b6d12aad93 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] No waiting events found dispatching network-vif-plugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 {{(pid=73068) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 12:35:56 user nova-compute[73068]: WARNING nova.compute.manager [req-1fa6ccb4-62ba-4d5b-acb6-7f1b2ea55a89 req-a0b44d45-bf44-494a-871a-44b6d12aad93 service nova] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Received unexpected event network-vif-plugged-215cca44-7d41-4717-b376-b3b9b1fe6da1 for instance with vm_state deleted and task_state None.
Aug 26 12:36:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:36:10 user nova-compute[73068]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693053355.0123186, 3790c4fd-5f8f-4781-ae30-745e0a31df9e => Stopped> {{(pid=73068) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 12:36:10 user nova-compute[73068]: INFO nova.compute.manager [-] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] VM Stopped (Lifecycle Event)
Aug 26 12:36:10 user nova-compute[73068]: DEBUG nova.compute.manager [None req-61c92375-7a4b-456f-b965-abb18e69a509 None None] [instance: 3790c4fd-5f8f-4781-ae30-745e0a31df9e] Checking state {{(pid=73068) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 12:36:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:36:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:36:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:36:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:36:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:10 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:36:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:36:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:36:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:36:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:36:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:20 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:25 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:30 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:34 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:36:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:36:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:36:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:36:34 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Auditing locally available compute resources for user (node: user) {{(pid=73068) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 12:36:34 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:36:34 user nova-compute[73068]: WARNING nova.virt.libvirt.driver [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 12:36:34 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=25.217967987060547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73068) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 12:36:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 12:36:34 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73068) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG nova.compute.provider_tree [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed in ProviderTree for provider: e49cbbd6-e608-41cf-a55c-7dee214caafe {{(pid=73068) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG nova.scheduler.client.report [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Inventory has not changed for provider e49cbbd6-e608-41cf-a55c-7dee214caafe based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73068) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG nova.compute.resource_tracker [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Compute_service record updated for user:user {{(pid=73068) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 12:36:35 user nova-compute[73068]: DEBUG oslo_concurrency.lockutils [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=73068) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 12:36:36 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:36:36 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73068) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 12:36:38 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:36:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:36:39 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:36:40 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:40 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:36:42 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:36:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:45 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:47 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:36:48 user nova-compute[73068]: DEBUG oslo_service.periodic_task [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73068) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 12:36:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Starting heal instance info cache {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 12:36:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Rebuilding the list of instances to heal {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 12:36:48 user nova-compute[73068]: DEBUG nova.compute.manager [None req-46907e3e-443a-4c6d-824a-a65383fec476 None None] Didn't find any instances for network info cache update. {{(pid=73068) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 12:36:48 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:50 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:51 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:36:55 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:37:00 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:37:05 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:37:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:37:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 12:37:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73068) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 12:37:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:37:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73068) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 12:37:10 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 12:37:15 user nova-compute[73068]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73068) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}